All columns anomalies
The elementary.all_columns_anomalies
test executes column-level monitors and anomaly detection on all columns of the table. It checks the data type of each column and only executes monitors that are relevant to it.
How it works
The test analyzes all columns in the table.
Based on the data type of each column, it applies relevant monitors.
You can override default monitors using the
column_anomalies
parameter.Columns can be excluded using
exclude_prefix
orexclude_regexp
parameters.
Default Monitors by Data Type
null_count
any
null_percent
any
min_length
string
max_length
string
average_length
string
missing_count
string
missing_percent
string
min
numeric
max
numeric
average
numeric
zero_count
numeric
zero_percent
numeric
standard_deviation
numeric
variance
numeric
Opt-in monitors by type:
sum
numeric
Test configuration
No mandatory configuration, however it is highly recommended to configure a timestamp_column
.
Important Notes
No mandatory configuration, however, it is highly recommended to configure a
timestamp_column
.Use
column_anomalies
to specify which monitors to run (if not specified, all default monitors will run).exclude_prefix
andexclude_regexp
can be used to exclude specific columns from the test.The
where_expression
can be used to filter the data being tested.Global sensitivity can be adjusted using the
anomaly_sensitivity
parameter.Tags can be used to run elementary tests on a dedicated run.
Last updated