DLT release 2023.45

November 13 - 30, 2023

These features and improvements were released with the 2023.45 release of DLT.

Note

Releases are staged. Your DLT release, including Databricks Runtime versions, might not be updated until a week or more after the initial release date.

Databricks Runtime versions used by this release

Channel:

• CURRENT (default): Databricks Runtime 12.2.16
• PREVIEW: Databricks Runtime 13.3.5

New features and improvements in this release

• (Public Preview) The new Validate feature allows you to quickly check for problems, such as syntax and analysis errors, in a pipeline’s source code. Because Validate does not update any tables, you save time and resources when developing and testing pipelines. See Check a pipeline for errors without waiting for tables to update.

• You can now select a Unity Catalog schema for a pipeline from a drop-down menu showing available schemas. See Use Unity Catalog with your DLT pipelines.

• You now have the option to selectively refresh a pipeline even if the latest update did not produce a valid DAG, allowing you to save the time and resources required to perform a full refresh of the pipeline. See Start a pipeline update for selected tables.