Skip to main content
Submit a GCP Dataproc job to a cluster from a Bolt schedule to run Spark and related workloads as part of your pipeline.

Prerequisites

Usage

Add the Run GCP Dataproc Job command to your schedule and enter the command to run. The modal accepts any command supported by the Paradime GCP Dataproc CLI:
Supported job types: pyspark, spark, hive, spark-sql, pig, and presto.

Learn more

See the Paradime GCP Dataproc CLI for the full command and flag reference.