Incremental models enable dbtâ˘ď¸ to selectively insert or update records in a table based on changes since the model's last execution.
Advantages:
Improved efficiency: Significantly reduces build time by processing only new or modified records.
Disadvantages:
Increased complexity: Requires additional configuration and is considered an advanced dbtâ˘ď¸ feature. (For more detailed information, refer to the dedicated guide on implementing incremental models.)
Best Practices:
Ideal data type: Most effective for event-style data sets.
Performance optimization: Consider implementing incremental models when you notice your
dbt
run
operations becoming excessively time-consuming.Implementation timing: It's recommended to start with simpler materialization strategies and transition to incremental models only when necessary for performance reasons.
Last updated
Was this helpful?