> ## Documentation Index
> Fetch the complete documentation index at: https://docs.paradime.io/llms.txt
> Use this file to discover all available pages before exploring further.

# GCP Dataproc

> Submit jobs to Google Cloud Dataproc clusters from Paradime Bolt schedules and the CLI to orchestrate Spark and Hadoop workloads next to your dbt runs.

[Google Cloud Dataproc](https://cloud.google.com/dataproc) is a managed service for running Apache Spark and Apache Hadoop workloads on GCP clusters. Trigger Dataproc jobs as part of your Paradime Bolt schedules using the Paradime CLI.

## What you can do

* Submit a job to a Dataproc cluster (pyspark, spark, hive, spark-sql, pig, or presto), optionally waiting for completion
* List all Dataproc clusters in a project and region

## Prerequisites

* `GCP_SERVICE_ACCOUNT_KEY_FILE`: path to a GCP service account JSON key file with permissions to submit Dataproc jobs and list clusters
* `GCP_PROJECT_ID`: your GCP project ID
* `GCP_LOCATION`: GCP region (e.g. 'us-central1')

## Trigger from Bolt

Set your credentials as [environment variables](/products/settings/environment-variables/bolt-schedule-env-variables) on your Bolt schedule, then run the command as part of the schedule.

See the full command reference, flags, and examples in the [GCP Dataproc CLI](/developers/paradime-cli/gcp-dataproc-cli) documentation.


## Related topics

- [GCP Dataproc CLI](/developers/paradime-cli/gcp-dataproc-cli.md)
- [GCP Dataflow](/integrations/gcp-dataflow.md)
- [GCP Datastream](/integrations/gcp-datastream.md)
- [GCP Dataflow CLI](/developers/paradime-cli/gcp-dataflow-cli.md)
- [GCP Datastream CLI](/developers/paradime-cli/gcp-datastream-cli.md)