DLT release 2023.16

April 24 - 28, 2023

These features and improvements were released with the 2023.16 release of DLT.

Databricks Runtime versions used by this release

Channel:

• CURRENT (default): Databricks Runtime 11.3.10
• PREVIEW: Databricks Runtime 12.2.3

New features and improvements in this release

• DLT support for Unity Catalog is in Public Preview. You can use Unity Catalog with your DLT pipelines to:

  • Define a catalog in Unity Catalog where your pipeline will persist tables.
  • Read data from Unity Catalog tables.

  See Use Unity Catalog with your DLT pipelines.

• By default, streaming tables require append-only sources. This release introduces the skipChangeCommits flag that can be set on a target streaming table to ignore changes in a source streaming table when the source table requires updates or deletes. See Configure a streaming table to ignore changes in a source streaming table.

• With this release, the limit for concurrent updates in a workspace is increased to 100. The previous concurrent updates limit was 20.

• DLT is now supported in Azure China regions.

• When you run a DLT pipeline from a pipeline notebook, you can now view the event log in the notebook sidebar. See Develop and debug DLT pipelines in notebooks.

Bug fixes in this release

• This release fixes a bug causing the pipelines list page to crash when the “%” character was entered in the search box.