databricks_workspace
Manage clusters, jobs, notebooks, MLflow and other Databricks workspace resources.
info
For Databricks account operations use the databricks_account provider.
Provider Summary
total services: 26 total resources: 278
See also: [SHOW] [DESCRIBE] [REGISTRY]
Installation
REGISTRY PULL databricks_workspace;
Authentication
To use the databricks_workspace provider, you can authenticate using one of the following methods:
OAuth2 (Service Principal) [Default]
Set the following environment variables:
DATABRICKS_ACCOUNT_ID- a uuid representing your Databricks account id, you can get this from the Databricks UI (see Locate your account id)DATABRICKS_CLIENT_ID- obtained after creating a service principal through the Databricks UI (see Authenticate access to Databricks with a service principal using OAuth)DATABRICKS_CLIENT_SECRET- obtained after creating a service principal secret through the Databricks UI, using the "Generate Secret" function (see Authenticate access to Databricks with a service principal using OAuth)
These are the same variables that Terraform, the Databricks SDKs, and CLI use.
Personal Access Token (Bearer)
Alternatively, set DATABRICKS_TOKEN to a Databricks personal access token (see Databricks personal access tokens), then supply the auth config when starting the shell:
export DATABRICKS_TOKEN=xxx
# Linux/Mac
AUTH='{ "databricks_workspace": { "type": "bearer", "credentialsenvvar": "DATABRICKS_TOKEN" }}'
./stackql shell --auth="${AUTH}"
# PowerShell
$Auth = "{ 'databricks_workspace': { 'type': 'bearer', 'credentialsenvvar': 'DATABRICKS_TOKEN' }}"
stackql.exe shell --auth=$Auth