How to Run AWS Glue Job with Parameters | Pass Dynamic Parameters in AWS Glue Easily | Step by Step
Автор: Cloud and Coffee with Navnit
Загружено: 2025-03-23
Просмотров: 1043
Learn How to Run an AWS Glue Job with Parameters! In this tutorial, I’ll walk you through setting up an AWS Glue job, passing parameters, and executing it using the AWS Console, AWS CLI, and Boto3 (Python SDK).
CLI
aws glue start-job-run \
--job-name my-glue-job \
--arguments '{"--SOURCE_DATA_PATH":"s3://my-source-data/", "--DATABASE_NAME":"my_database", "--TABLE_NAME":"my_table", "--WAREHOUSE_PATH":"s3://my-warehouse/"}'
SDK
import boto3
glue = boto3.client('glue')
response = glue.start_job_run(
JobName='my-glue-job',
Arguments={
'--SOURCE_DATA_PATH': 's3://my-source-data/',
'--DATABASE_NAME': 'my_database',
'--TABLE_NAME': 'my_table',
'--WAREHOUSE_PATH': 's3://my-warehouse/'
}
)
print("Glue Job Started, Run ID:", response['JobRunId'])
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
