BigQuery
Last updated
Was this helpful?
Last updated
Was this helpful?
Google BigQuery is a fully managed, serverless data warehouse that enables scalable analysis over petabytes of data. As a development environment in Paradime, BigQuery enables dbt™ development from Paradime's Code IDE.
IP RESTRICTIONS
Make sure to allow traffic from one of the Paradime IPs in your firewall depending on the data location selected.
👉 See also: .
The following permissions will enable users in Paradime to run dbt™ from Paradime in your BigQuery project:
BigQuery Data Editor
BigQuery User
Click Settings in the top menu bar of the Paradime interface to access Account Settings
Click "Connections" in the left sidebar
Click "Add New" next to Code IDE Environment
Select "BigQuery"
Next, choose your preferred authentification method to proceed:
Below are list of fields and example to create a connection.
Profile Name
dbt-bigquery
Target
dev
Dataset Location
The location of BigQuery datasets can be configured using the location configuration in a BigQuery profile.
US
Project ID
dbt-demo-project
Client ID
The Client ID generated when setting up the OAuth credentials.
xyz123.apps.googleusercontent.com
Client Secret
The Client Secret generated when setting up the OAuth credentials.
GOCSPX-hPfGJe7sd238772BLBA2Bi0ds
Execution Project ID (Optional)
(Optional) analytics-global-project
Dataset
The default dataset used to build dbt™️ objects at runtime.
dbt_john
Threads
8
Uploading a service account JSON key file is the quickly and accurately way to configure a connection to BigQuery and authenticate each user's development credentials.
Below are list of fields and example to create a connection.
Profile Name
dbt-bigquery
Target
dev
Dataset Location
The location of BigQuery datasets can be configured using the location configuration in a BigQuery profile.
US
Service AccountService Account JSON
The service account JSON file created for this service user.
service_account_user.json
Execution Project ID (Optional)
(Optional) analytics-global-project
Dataset
The default dataset used to build dbt™️ objects at runtime.
dbt_john
Threads
8
Follow our guide to configure OAuth authentication. Each user will need to approve the required scopes when connecting.
The profile name set in your dbt_project.yaml
. See more .
The target name used to identify the connection. See more .
Location can be either a multi-regional location (e.g. EU
, US
), or a regional location (e.g. europe-west2
). See more .
The unique identifier of your BigQuery project. See more .
You can specify an Execution Project ID to bill for query execution, instead of the project where you materialize your resources. See more .
The number of threads used in this connection. See more .
To create a service account in BigQuery, follow the detailed steps in .
The profile name set in your dbt_project.yaml
. See more .
The target name used to identify the connection. See more .
Location can be either a multi-regional location (e.g. EU
, US
), or a regional location (e.g. europe-west2
). See more .
You can specify an Execution Project ID to bill for query execution, instead of the project where you materialize your resources. See more .
The number of threads used in this connection. See more .