Real-time Alerting
Radar's real-time Alerting feature provides instant notifications for critical events in your data pipeline, allowing you to act promptly on issues related to job performance, cost spikes, and data quality. This proactive approach helps maintain SLA targets and control costs effectively.
Prerequisites
Completed the Real-time Alerting setup in Radar's Get Started guide.
Key Features
Comprehensive Coverage: Built-in alerts for various scenarios for your pipelines: Snowflake, BigQuery, Bolt Schedules.
Multi-channel Notifications: Receive on-time alerts via Slack, MS Teams, and email.
Available Alerts
Project Cost Anomaly Alert
Alerts when a project's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days.
20
User Cost Anomaly Alert
Alerts when a user's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly users.
20
dbt Cost Anomaly Alert
Alerts when a dbt model's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly dbt models.
20
Query Cost Anomaly Alert
Alerts when a specific query's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly queries.
20
Warehouse Compute Cost Anomaly Alert
Alerts when a warehouse's compute cost exceeds a set percentage (e.g., 20%) of the daily average costs over the past 7 days.
20
Query Remote Spillage Ratio Anomaly Alert
Alerts when the ratio of bytes spilled to remote storage exceeds 5 times the total bytes scanned. Focuses on the top 10 queries with the highest costs.
5
Project Cost Anomaly Alert
Alerts when a project's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days.
20
User Cost Anomaly Alert
Alerts when a user's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly users.
20
dbt Cost Anomaly Alert
Alerts when a dbt model's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly dbt models.
20
Query Cost Anomaly Alert
Alerts when a specific query's cost exceeds a set percentage (e.g., 20%) above the daily average over the past 7 days. Focuses on the top 10 costly queries.
20
Small Query Waste Anomaly Alert
Alerts when the difference between billed bytes and processed bytes exceeds a set percentage (e.g., 5%) of total billed bytes for a project in a day.
5
High Shuffle Spill Anomaly Alert
Alerts when shuffled bytes spilled to disk exceed a set percentage (e.g., 20%) of total bytes processed. Focuses on the top 10 queries with the highest processed bytes.
20
Query Runtime Anomaly Alert
Alerts when query runtime increases by more than a set percentage (e.g., 50%) compared to the average over the past week.
20
Query Slot Usage Anomaly Alert
Alerts when average slot usage increases by more than a set percentage (e.g., 50%) compared to the average over the past week. Focuses on the top 10 costly queries.
50
1. How to Configure Alerts
Navigate to the Data Alerts section in Radar.
Select the alert you want to configure.
Set the threshold for the alert. For example:
A threshold of
20means the alert will trigger when costs exceed 20% above the average of the past 7 days.
Choose a minimum value for the alert. Absolute value thresholds allows you to reduce the noise so that only if the %age increase is above a certain value it will trigger an alert.
Click the toggle switch to enable/disable the alert.
2. Receiving and Acting on Alerts
When an alert is triggered, you'll receive a notification through your configured channels (Slack, MS Teams, or email). The alert will provide:
A description of the issue
Relevant metrics and comparisons
Suggested actions to address the problem
How to Act on Alerts:
Use this information to quickly diagnose and resolve issues, helping to maintain the efficiency and cost-effectiveness of your data operations.
Last updated
Was this helpful?