How to Run AWS Glue Job with Parameters | Pass Dynamic Parameters in AWS Glue Easily | Step by Step

Learn How to Run an AWS Glue Job with Parameters! In this tutorial, I’ll walk you through setting up an AWS Glue job, passing parameters, and executing it using the AWS Console, AWS CLI, and Boto3 (Python SDK).

CLI
aws glue start-job-run \
--job-name my-glue-job \
--arguments '{"--SOURCE_DATA_PATH":"s3://my-source-data/", "--DATABASE_NAME":"my_database", "--TABLE_NAME":"my_table", "--WAREHOUSE_PATH":"s3://my-warehouse/"}'


SDK

import boto3

glue = boto3.client('glue')

response = glue.start_job_run(
JobName='my-glue-job',
Arguments={
'--SOURCE_DATA_PATH': 's3://my-source-data/',
'--DATABASE_NAME': 'my_database',
'--TABLE_NAME': 'my_table',
'--WAREHOUSE_PATH': 's3://my-warehouse/'
}
)

print("Glue Job Started, Run ID:", response['JobRunId'])