Configuring Source Freshness
Monitor the freshness of your source data by configuring the dbt source freshness
command in your Bolt schedules. This helps ensure your data meets defined SLAs and maintains quality standards.
Overview
When you include the dbt source freshness
command in your schedule, Bolt tracks and reports the last update time of your source tables. This information appears in the Source Freshness section of your run details.
Configuration Steps:
1. Add Required Fields
To enable source freshness checking, add these elements to your source configuration:
A
freshness
block to define timing thresholdsA
loaded_at_field
to specify the timestamp column
The loaded_at_field
is required for freshness checking. Without it, dbt will skip freshness calculations for that table.
2. Define Freshness Rules
In your freshness
block, specify one or both timing thresholds:
warn_after
: Triggers a warning when data exceeds this ageerror_after
: Marks data as error state when exceeding this age
👉 See also: freshness definition and configurations.
Configuration Example
Last updated