GCP BigQuery Transfer - Paradime

GCP BigQuery Transfer Data Transfer Service automates data movement into BigQuery on a schedule, including scheduled queries. Trigger it from a Paradime Bolt schedule with the Paradime CLI, so it runs as part of your pipeline.

What you can do

Trigger one or more scheduled queries by display name

Prerequisites

A service account with permission to run BigQuery Data Transfer configs (BigQuery Admin or equivalent).

Set up

Paradime authenticates to GCP with a service account key. Set them as Bolt schedule environment variables:

Variable	Required	Description
`GCP_SERVICE_ACCOUNT_KEY_FILE`	Required	Path to your GCP service account JSON key file.
`GCP_PROJECT_ID`	Required	Your GCP project ID.
`GCP_LOCATION`	Optional	BigQuery Data Transfer location (for example, `us`, `eu`). Default: `us`.

Trigger from Bolt

Add the Run BigQuery Scheduled Query command to a schedule. For the full command reference, flags, and examples, see the GCP BigQuery Transfer CLI.

Related topics

Run BigQuery Scheduled Query GCP BigQuery Data Transfer CLI BigQuery OAuth BigQuery BigQuery Tools