Skip to main content

quality_monitor_refreshes

Creates, updates, deletes, gets or lists a quality_monitor_refreshes resource.

Overview

Namequality_monitor_refreshes
TypeResource
Iddatabricks_workspace.catalog.quality_monitor_refreshes

Fields

The following fields are returned by SELECT queries:

NameDatatypeDescription
refresh_idinteger
end_time_msintegerTime at which refresh operation completed (milliseconds since 1/1/1970 UTC).
messagestringAn optional message to give insight into the current state of the job (e.g. FAILURE messages).
start_time_msintegerTime at which refresh operation was initiated (milliseconds since 1/1/1970 UTC).
statestringThe current state of the refresh. (CANCELED, FAILED, PENDING, RUNNING, SUCCESS, UNKNOWN)
triggerstringThe method by which the refresh was triggered. (MANUAL, SCHEDULE, UNKNOWN_TRIGGER)

Methods

The following methods are available for this resource:

NameAccessible byRequired ParamsOptional ParamsDescription
getselecttable_name, refresh_id, deployment_name[DEPRECATED] Gets info about a specific monitor refresh using the given refresh ID. Use Data Quality
listselecttable_name, deployment_name[DEPRECATED] Gets an array containing the history of the most recent refreshes (up to 25) for this
runexectable_name, deployment_name[DEPRECATED] Queues a metric refresh on the monitor for the specified table. Use Data Quality Monitors

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

NameDatatypeDescription
deployment_namestringThe Databricks Workspace Deployment Name (default: dbc-abcd0123-a1bc)
refresh_idintegerID of the refresh.
table_namestringUC table name in format catalog.schema.table_name. table_name is case insensitive and spaces are disallowed.

SELECT examples

[DEPRECATED] Gets info about a specific monitor refresh using the given refresh ID. Use Data Quality

SELECT
refresh_id,
end_time_ms,
message,
start_time_ms,
state,
trigger
FROM databricks_workspace.catalog.quality_monitor_refreshes
WHERE table_name = '{{ table_name }}' -- required
AND refresh_id = '{{ refresh_id }}' -- required
AND deployment_name = '{{ deployment_name }}' -- required
;

Lifecycle Methods

[DEPRECATED] Queues a metric refresh on the monitor for the specified table. Use Data Quality Monitors

EXEC databricks_workspace.catalog.quality_monitor_refreshes.run 
@table_name='{{ table_name }}' --required,
@deployment_name='{{ deployment_name }}' --required
;