Skip to main content

serving_endpoint_ai_gateway

Creates, updates, deletes, gets or lists a serving_endpoint_ai_gateway resource.

Overview

Nameserving_endpoint_ai_gateway
TypeResource
Iddatabricks_workspace.serving.serving_endpoint_ai_gateway

Fields

The following fields are returned by SELECT queries:

SELECT not supported for this resource, use SHOW METHODS to view available operations for the resource.

Methods

The following methods are available for this resource:

NameAccessible byRequired ParamsOptional ParamsDescription
updatereplacename, deployment_nameUsed to update the AI Gateway of a serving endpoint. NOTE: External model, provisioned throughput, and

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

NameDatatypeDescription
deployment_namestringThe Databricks Workspace Deployment Name (default: dbc-abcd0123-a1bc)
namestringThe name of the serving endpoint whose AI Gateway is being updated. This field is required.

REPLACE examples

Used to update the AI Gateway of a serving endpoint. NOTE: External model, provisioned throughput, and

REPLACE databricks_workspace.serving.serving_endpoint_ai_gateway
SET
fallback_config = '{{ fallback_config }}',
guardrails = '{{ guardrails }}',
inference_table_config = '{{ inference_table_config }}',
rate_limits = '{{ rate_limits }}',
usage_tracking_config = '{{ usage_tracking_config }}'
WHERE
name = '{{ name }}' --required
AND deployment_name = '{{ deployment_name }}' --required
RETURNING
fallback_config,
guardrails,
inference_table_config,
rate_limits,
usage_tracking_config;