AWS Glue - Paradime

AWS Glue is a serverless data integration service for discovering, preparing, and combining data for analytics and ETL. Trigger it from a Paradime Bolt schedule with the Paradime CLI, so it runs as part of your pipeline.

What you can do

Trigger one or more Glue workflows from a Bolt schedule
Trigger one or more Glue ETL jobs from a Bolt schedule
List available Glue workflows and jobs with their status

Prerequisites

An IAM user or role with permissions to run the relevant Glue actions (for example, glue:StartWorkflowRun, glue:StartJobRun).

Set up

Paradime authenticates to AWS with your IAM credentials. Set them as Bolt schedule environment variables:

Variable	Required	Description
`AWS_ACCESS_KEY_ID`	Required	Access key ID for an IAM user or role.
`AWS_SECRET_ACCESS_KEY`	Required	Secret access key for the IAM user or role.
`AWS_REGION`	Required	AWS region your resources are in (for example, `us-east-1`).
`AWS_SESSION_TOKEN`	Optional	Session token, only for temporary credentials.

Trigger from Bolt

Add the Run AWS Glue command to a schedule. For the full command reference, flags, and examples, see the AWS Glue CLI.

Related topics

AWS Glue CLI Run AWS Glue Integrations Commands New Bolt command integrations

⌘I