Configuration reference
This article provides reference for keys supported by Databricks Asset Bundles configuration (YAML). See What are Databricks Asset Bundles?.
For complete bundle examples, see Bundle configuration examples and the bundle-examples GitHub repository.
artifact
Defines the settings to build an artifact.
Key | Type | Description |
---|---|---|
build |
String | An optional set of non-default build commands to run locally before deployment. |
executable |
String | The executable type. Valid values are bash , sh , and cmd . |
files |
Map | The source files for the artifact, defined as an artifact_file. |
path |
String | The location where the built artifact will be saved. |
type |
String | Required. The type of the artifact. Valid values are whl . |
artifacts
Defines the attributes to build artifacts, where each key is the name of the artifact, and the value is a Map that defines the artifact build settings. For information about the artifacts
mapping, see artifacts.
Artifact settings defined in the top level of the bundle configuration can be overridden in the targets
mapping. See Define artifact settings in Databricks Asset Bundles.
artifacts:
<artifact-name>:
<artifact-field-name>: <artifact-field-value>
Example
artifacts:
default:
type: whl
build: poetry build
path: .
artifact_file
Defines an artifact file in a bundle.
Key | Type | Description |
---|---|---|
source |
String | Required. The path of the files used to build the artifact. |
bundle
The attributes of the bundle. See bundle.
Key | Type | Description |
---|---|---|
cluster_id |
String | The ID of a cluster to use to run the bundle. See cluster_id. |
databricks_cli_version |
String | The Databricks CLI version to use for the bundle. See databricks_cli_version. |
deployment |
Map | The definition of the bundle deployment. For supported attributes, see deployment and Databricks Asset Bundle deployment modes. |
git |
Map | The Git version control details that are associated with your bundle. For supported attributes, see git and git. |
name |
String | Required. The name of the bundle. |
deployment
Defines bundle deployment attributes.
Key | Type | Description |
---|---|---|
fail_on_active_runs |
Boolean | Whether to fail on active runs. If this is set to true a deployment that is running can be interrupted. |
lock |
Map | The deployment lock attributes. See lock. |
experimental
Defines attributes for experimental features.
Key | Type | Description |
---|---|---|
python_wheel_wrapper |
Boolean | Whether to use a Python wheel wrapper. |
scripts |
Command (String) | The commands to run |
use_legacy_run_as |
Boolean | Whether to use the legacy run_as behavior. |
git
Defines the Git version control details that are associated with the bundle. See git.
Key | Type | Description |
---|---|---|
origin_url |
String | The origin URL of the repository. See git. |
branch |
String | The Git branch name. See git. |
grant
Defines access to Unity Catalog objects. For more information, see Connect to cloud object storage and services using Unity Catalog.
Key | Type | Description |
---|---|---|
principal |
String | Required. The name of the principal that will be granted privileges. |
privileges |
String | Required. The privileges to grant to the specified entity. |
Example
The following example defines a Unity Catalog schema with grants:
resources:
schemas:
my_schema:
name: test-schema
grants:
- principal: users
privileges:
- CAN_MANAGE
- principal: my_team
privileges:
- CAN_READ
catalog_name: main
comment: "my schema with grants"
lock
Defines the bundle deployment lock attributes.
Key | Type | Description |
---|---|---|
enabled |
Boolean | Whether this lock is enabled. |
force |
Boolean | Whether to force this lock if it is enabled. |
permission
Defines a permission for a specific entity. See permissions and Set permissions for resources in Databricks Asset Bundles.
Key | Type | Description |
---|---|---|
group_name |
String | The name of the group that has the permission set in level . |
level |
String | Required. The allowed permission for user, group, service principal defined for this permission. |
service_principal_name |
String | The name of the service principal that has the permission set in level . |
user_name |
String | The name of the user that has the permission set in level . |
permissions
A Sequence that defines the permissions to apply to experiments, jobs, pipelines, and models defined in the bundle, where each item in the sequence is a permission for a specific entity.
See permissions and Set permissions for resources in Databricks Asset Bundles.
Example
permissions:
- level: CAN_VIEW
group_name: test-group
- level: CAN_MANAGE
user_name: someone@example.com
- level: CAN_RUN
service_principal_name: 123456-abcdef
presets
Defines bundle deployment presets. See Custom presets.
Key | Type | Description |
---|---|---|
jobs_max_concurrent_runs |
Integer | The maximum concurrent runs for a job. |
name_prefix |
String | The prefix for job runs of the bundle. |
pipelines_development |
Boolean | Whether pipeline deployments should be locked in development mode. |
source_linked_deployment |
Boolean | Whether to link the deployment to the bundle source. |
tags |
Map | The tags for the bundle deployment. |
trigger_pause_status |
String | A pause status to apply to all job triggers and schedules. Valid values are PAUSED or UNPAUSED . |
resources
A Map that defines the resources for the bundle, where each key is the name of the resource, and the value is a Map that defines the resource. For more information about Databricks Asset Bundles supported resources, and resource definition reference, see Databricks Asset Bundles resources.
resources:
<resource-type>s:
<resource-name>:
<resource-field-name>: <resource-field-value>
Key | Type | Description |
---|---|---|
clusters |
Map | The cluster definitions for the bundle, where each key is the name of a cluster. See cluster |
dashboards |
Map | The dashboard definitions for the bundle, where each key is the name of the dashboard. See dashboard |
experiments |
Map | The experiment definitions for the bundle, where each key is the name of the experiment. See experiment |
jobs |
Map | The job definitions for the bundle, where each key is the name of the job. See job |
model_serving_endpoints |
Map | The model serving endpoint definitions for the bundle, where each key is the name of the model serving endpoint. See model_serving_endpoint |
models |
Map | The model definitions for the bundle, where each key is the name of the model. See model (legacy) |
pipelines |
Map | The pipeline definitions for the bundle, where each key is the name of the pipeline. See pipeline |
quality_monitors |
Map | The quality monitor definitions for the bundle, where each key is the name of the quality monitor. See quality_monitor (Unity Catalog) |
registered_models |
Map | The registered model definitions for the bundle, where each key is the name of the Unity Catalog registered model. See registered_model (Unity Catalog) |
schemas |
Map | The schema definitions for the bundle, where each key is the name of the schema. See schema (Unity Catalog) |
volumes |
Map | The volume definitions for the bundle, where each key is the name of the volume. See volume (Unity Catalog) |
run_as
The identity to use when running Databricks Asset Bundles workflows. See Specify a run identity for a Databricks Asset Bundles workflow.
Key | Type | Description |
---|---|---|
service_principal_name |
String | The application ID of an active service principal. Setting this field requires the servicePrincipal/user role. |
user_name |
String | The email of an active workspace user. Non-admin users can only set this field to their own email. |
sync
The files and file paths to include or exclude in the bundle. See sync.
Key | Type | Description |
---|---|---|
exclude |
Sequence | A list of files or folders to exclude from the bundle. |
include |
Sequence | A list of files or folders to include in the bundle. |
paths |
Sequence | The local folder paths, which can be outside the bundle root, to synchronize to the workspace when the bundle is deployed. |
target
Defines deployment targets for the bundle. See targets
Key | Type | Description |
---|---|---|
artifacts |
Map | The artifacts to include in the target deployment. See artifacts. |
bundle |
Map | The bundle attributes when deploying to this target. |
cluster_id |
String | The ID of the cluster to use for this target. |
compute_id |
String | Deprecated. The ID of the compute to use for this target. |
default |
Boolean | Whether this target is the default target. |
git |
Map | The Git version control settings for the target. See git. |
mode |
String | The deployment mode for the target. Valid values are development or production . See Databricks Asset Bundle deployment modes. |
permissions |
Sequence | The permissions for deploying and running the bundle in the target. See permissions. |
presets |
Map | The deployment presets for the target. See presets. |
resources |
Map | The resource definitions for the target. See resources. |
run_as |
Map | The identity to use to run the bundle. See run_as and Specify a run identity for a Databricks Asset Bundles workflow. |
sync |
Map | The local paths to sync to the target workspace when a bundle is run or deployed. See sync. |
variables |
Map | The custom variable definitions for the target. See variables and Substitutions and variables in Databricks Asset Bundles. |
workspace |
Map | The Databricks workspace for the target. workspace |
variables
A Map that defines the custom variables for the bundle, where each key is the name of the variable, and the value is a Map that defines the variable. See Substitutions and variables in Databricks Asset Bundles.
Key | Type | Description |
---|---|---|
variable-name | Map | The definition of a variable. See variable-name. |
variable-name
Each variable definition has the following attributes:
Key | Type | Description |
---|---|---|
description |
String | The description of the variable. |
lookup |
String | The name of the alert , cluster_policy , cluster , dashboard , instance_pool , job , metastore , pipeline , query , service_principal , or warehouse object for which to retrieve an ID. |
type |
String | The type of the variable. Valid values are complex . |
workspace
Defines the Databricks workspace for the bundle. See workspace.
Key | Type | Description |
---|---|---|
artifact_path |
String | The artifact path to use within the workspace for both deployments and workflow runs |
auth_type |
String | The authentication type. |
azure_client_id |
String | The Azure client ID. |
azure_environment |
String | The Azure environment. |
azure_login_app_id |
String | The Azure login app ID. |
azure_tenant_id |
String | The Azure tenant ID. |
azure_use_msi |
Boolean | Whether to use MSI for Azure. |
azure_workspace_resource_id |
String | The Azure workspace resource ID. |
client_id |
String | The client ID for the workspace. |
file_path |
String | The file path to use within the workspace for both deployments and workflow runs. |
google_service_account |
String | The Google service account name. |
host |
String | The Databricks workspace host URL. |
profile |
String | The Databricks workspace profile name. |
resource_path |
String | The workspace resource path. |
root_path |
String | The Databricks workspace root path. |
state_path |
String | The workspace state path. |