Setting Up Data Warehouse Connections

In this guide, you'll learn how to set up and manage multiple data warehouse connections within your Paradime workspace. This process is crucial for configuring connections for both development in the Paradime Code IDE and running dbt™ in production with the Bolt Scheduler.

Estimated completion time: 10 minutes

Prerequisites

• An admin role In Paradime to create workspaces

What you'll learn

In this guide, you'll learn how to:

1. Add a Bolt Scheduler connection

2. Add a TurboCI connection

3. Manage your connections

4. Use targets with dbt™ commands

---

Video Tutorial

The following video provides step-by-step instructions for adding a scheduler environment (bolt scheduler) and a Turbo CI connection.

---

1. Add a Bolt Scheduler Connection

This connection will be used as the default target for your Bolt schedules to run dbt™ in production.

1. Navigate to your account settings

2. Locate the Connections tab.

3. Click Add New button in the Scheduler section.

4. Select your data warehouse provider (e.g., Snowflake)

5. Configure the connection details.

6. Click 'Test Connection' to verify the setup.

💡 For visual guidance, follow video tutorial.

---

2. Add a TurboCI Connection

This connection will be used specifically for running dbt™ with TurboCI to build and test your dbt™ models when opening a Pull Request.

1. Follow steps 1-3 from the above section, Add a Bolt Scheduler Connection

2. Configure the connection details:

   • Provide a dbt™ profile name (This should match with the profile name set in your dbt_project.yml).

   • Set the target as CI.

   • Enter your data warehouse credentials (similar to the Scheduler prod connection).

   • Change the schema name to dbt_ci (or your preferred CI schema).

   • Configure thread settings as needed.

3. Click Test Connection to verify the setup.

💡 For visual guidance, follow video tutorial.

---

3. Manage Your Connections

After setting up your connections, you'll have:

• A prod target connection for orchestrating production jobs.

• A ci target connection for running dbt™ with TurboCI.

These connections enable you to separate your development, testing, and scheduler environments effectively within Paradime.

---

4. Using Targets with dbt™ Commands

After setting up multiple connections, it's important to understand how to direct your dbt™ commands to use a specific target. This allows you to switch between multiple environments easily.

Default Behavior

By default, when you run a dbt™ command without specifying a target:

• In the Code IDE: It will use the default connection set for the Code IDE.

• In the Scheduler: It will use the default connection set for the Scheduler.

Example:

dbt run

It will use the default target for your current environment.

Specifying a Target

To use a specific target, append the --target argument to your dbt command:

dbt <command> --target <target_name>

For example, to run dbt using the 'CI' target we set up earlier:

dbt run --target ci

This command will execute the dbt run using the connection details specified in the ci target, regardless of the default setting.

---

Related Documentation

• Production Environments in Paradime

• CI/CD In Paradime

---

Summary

You've now set up multiple data warehouse connections, learned how to manage them, and understand how to use different targets with dbt™ commands. These skills will allow you to efficiently work across development, testing, and production environments in Paradime.

Next, we'll dive into Managing Workspace Configurations to further customize your Paradime environment.