Configuring Source Freshness
Monitor the freshness of your source data by configuring the dbt source freshness command in your Bolt schedules. This helps ensure your data meets defined SLAs and maintains quality standards.
Overview
When you include the dbt source freshness command in your schedule, Bolt tracks and reports the last update time of your source tables. This information appears in the Source Freshness section of your run details.
Configuration Steps:
1. Add Required Fields
To enable source freshness checking, add these elements to your source configuration:
A
freshnessblock to define timing thresholdsA
loaded_at_fieldto specify the timestamp column
2. Define Freshness Rules
In your freshness block, specify one or both timing thresholds:
warn_after: Triggers a warning when data exceeds this ageerror_after: Marks data as error state when exceeding this age
Configuration Example
Last updated
Was this helpful?