Data Exploration in the Code IDE

​

What You’ll Learn

• Use the Data Explorer for compilation and data preview
• Utilize the Scratchpad for temporary code experiments
• Leverage these tools to improve your workflow efficiency

​

1. Data Explorer

​

Key Features:

• JIT Live Compiler: Instantly see how your SQL compiles, including resolved macros and Jinja blocks.
• Data Preview with Customizable Limits: View query results directly in the IDE, with adjustable row limits.
• CSV Download Option: Easily export your preview data.
• Support for Partial SQL Previews: Test specific parts of your query by highlighting and previewing only the selected portion.

​

How to Use:

1. Access the Data Explorer: Click the 🔍 icon on the right panel to open the preview data view.
2. View Compiled SQL: Your compiled SQL will display automatically, showing resolved macros and Jinja blocks.

-- This is the original dbt model code
-- It uses the ref() function to reference another model
SELECT
  *
FROM
  {{ ref('nba_player_info') }}

-- This is the compiled SQL code
-- The ref() function has been resolved to the actual table name
SELECT
  *
FROM
  analytics.dbt_models.nba_player_info

3. Preview Data: Click the “Preview Data” button to view your dbt™️ model or query results.
4. Preview Partial SQL: Highlight a specific portion of SQL and click “Preview Data” to view results for that portion.
5. Adjust Query Limit: Change the default limit (1-1000) in the “Query Limit” text box.
6. Download Results: Click “Download CSV” to save preview data.

​

2. Scratchpad

​

Key Features:

1. Temporary File Creation: Quickly create and experiment with code without affecting main project files.
2. Support for SQL and dbt™ Syntax: Write queries using both standard SQL and dbt™-specific functions.
3. Instant Data Preview: Leverage the Data Explorer for immediate results.
4. Session Persistence: Scratchpad files remain available across sessions.
5. Automatic Git Ignoring: Keep your repository clean by excluding scratchpad files from version control.

​

How to Use:

1. Create a New Scratchpad File:
   • Click the “New File” button at the top-right of your screen.
   • Paradime creates a file in the “paradime_scratch” folder (e.g., “scratch-1”, “scratch-2”).
2. Write and Test Code:
   • Use SQL or dbt™️ syntax (including ref(), macros, etc.).
   • Leverage the Data Explorer for instant previews.
3. Organize Your Scratchpad:
   • Rename files as needed for better organization.
4. Utilize Across Sessions:
   • Scratchpad files remain available after logging out and back in.
5. Maintain a Clean Git Repository:
   • Scratchpad files are automatically gitignored.

​

Summary