All columns anomalies
Last updated
Last updated
The elementary.all_columns_anomalies
test executes column-level monitors and anomaly detection on all columns of the table. It checks the data type of each column and only executes monitors that are relevant to it.
The test analyzes all columns in the table.
Based on the data type of each column, it applies relevant monitors.
You can override default monitors using the column_anomalies
parameter.
Columns can be excluded using exclude_prefix
or exclude_regexp
parameters.
Data quality metric | Column Type |
---|---|
No mandatory configuration, however it is highly recommended to configure a timestamp_column
.
No mandatory configuration, however, it is highly recommended to configure a timestamp_column
.
Use column_anomalies
to specify which monitors to run (if not specified, all default monitors will run).
exclude_prefix
and exclude_regexp
can be used to exclude specific columns from the test.
The where_expression
can be used to filter the data being tested.
Global sensitivity can be adjusted using the anomaly_sensitivity
parameter.
Tags can be used to run elementary tests on a dedicated run.
Data quality metric | Column Type |
---|---|
null_count
any
null_percent
any
min_length
string
max_length
string
average_length
string
missing_count
string
missing_percent
string
min
numeric
max
numeric
average
numeric
zero_count
numeric
zero_percent
numeric
standard_deviation
numeric
variance
numeric
sum
numeric