Edit

Share via

What's new in Microsoft Fabric?

  • Article

This page is continuously updated with a recent review of what's new in Microsoft Fabric.

New to Microsoft Fabric?

Features currently in preview

The following table lists the features of Microsoft Fabric that are currently in preview. Preview features are sorted alphabetically.

Note

Features currently in preview are available under supplemental terms of use. Review for legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability. Microsoft Fabric provides previews to give you a chance to evaluate and share feedback with the product group on preview features before they become generally available (GA).

Feature Learn more
AutoML code-first preview In Fabric Data Science, the new AutoML feature enables automation of your machine learning workflow. AutoML, or Automated Machine Learning, is a set of techniques and tools that can automatically train and optimize machine learning models for any given data and task type.
AutoML low code user experience in Fabric (preview) AutoML, or Automated Machine Learning, is a process that automates the time-consuming and complex tasks of developing machine learning models. The new low code AutoML experience supports a variety of tasks, including regression, forecasting, classification, and multi-class classification. To get started, Create models with Automated ML (preview).
Azure Data Factory item You can now bring your existing Azure Data Factory (ADF) to your Fabric workspace. This new preview capability allows you to connect to your existing Azure Data Factory from your Fabric workspace. Select "Create Azure Data Factory" inside of your Fabric Data Factory workspace, and you can manage your Azure data factories directly from the Fabric workspace.
Capacity pools preview Capacity administrators can now create custom pools (preview) based on their workload requirements, providing granular control over compute resources. Custom pools for Data Engineering and Data Science can be set as Spark Pool options within Workspace Spark Settings and environment items.
Code-First Hyperparameter Tuning preview In Fabric Data Science, FLAML is now integrated for hyperparameter tuning, currently a preview feature. Fabric's flaml.tune feature streamlines this process, offering a cost-effective and efficient approach to hyperparameter tuning.
Copilot in Fabric is available worldwide Copilot in Fabric is now available to all customers, including Copilot for Power BI, Copilot for Data Factory, Copilot for Data Science & Data Engineering, and Copilot for Real-Time Intelligence. Read more in our Overview of Copilot in Fabric.
Copy job The Copy job (preview) in Data Factory has advantages over the Copy activity. For more information, see Announcing Preview: Copy Job in Microsoft Fabric. For a tutorial, see Learn how to create a Copy job (preview) in Data Factory for Microsoft Fabric.
Data Factory Apache Airflow jobs preview Apache Airflow job (preview) in Data Factory, powered by Apache Airflow, offer seamless authoring, scheduling, and monitoring experience for Python-based data processes defined as Directed Acyclic Graphs (DAGs). For more information, see Quickstart: Create an Apache Airflow Job.
Data pipeline capabilities in Copilot for Data Factory (preview) The new Data pipeline capabilities in Copilot for Data Factory are now available in preview. These features function as an AI expert to help users build, troubleshoot, and maintain data pipelines.
Data Wrangler for Spark DataFrames preview Data Wrangler on Spark DataFrames in preview. Users can now edit Spark DataFrames in addition to pandas DataFrames with Data Wrangler.
Data Science AI skill (preview) You can now build your own generative AI experiences over your data in Fabric with the AI skill (preview)! You can build question and answering AI systems over your Lakehouses and Warehouses. For more information, see Introducing AI Skills in Microsoft Fabric: Now in Preview. To get started, try AI skill example with the AdventureWorks dataset (preview).
Dataflow Gen2 with CI/CD and Git integration Dataflow Gen2 now supports Continuous Integration/Continuous Deployment (CI/CD) and Git integration. This preview feature allows you to create, edit, and manage dataflows in a Git repository that's connected to your fabric workspace. Additionally, you can use the deployment pipelines feature to automate the deployment of dataflows from your workspace to other workspaces. Also, you can use the Fabric Create, Read, Update, Delete, and List (CRUDL) API to manage Dataflow Gen2.
Delta column mapping in the SQL analytics endpoint SQL analytics endpoint now supports Delta tables with column mapping enabled. For more information, see Delta column mapping and Limitations of the SQL analytics endpoint. This feature is currently in preview.
Domains in OneLake (preview) Domains in OneLake help you organize your data into a logical data mesh, allowing federated governance and optimizing for business needs. You can now create sub domains, default domains for users, and move workspaces between domains. For more information, see Fabric domains.
Eventhouse Query Acceleration for OneLake Shortcuts (Preview) Query Acceleration for OneLake Shortcuts in Eventhouse speeds up ad hoc queries over data in OneLake. OneLake shortcuts are references from an Eventhouse that point to internal Fabric or external sources. Previously, queries run over OneLake shortcuts were less performant than on data that is ingested directly to Eventhouses due to various factors.
Eventstream processing and routing events to Activator (preview) Now, Eventstream supports processing and transforming events with business requirements before routing the events to the destination: Activator. When these transformed events reach Activator, you can establish rules or conditions for your alerts to monitor the events.
High concurrency mode for Notebooks in Pipelines (preview) High concurrency mode for Notebooks in Pipelines enables users to share Spark sessions across multiple notebooks within a pipeline. With high concurrency mode, users can trigger pipeline jobs, and these jobs are automatically packed into existing high concurrency sessions.
Fabric gateway enables OneLake shortcuts to on-premises data Connect to on-premises data sources with a Fabric on-premises data gateway on a machine in your environment, with networking visibility of your S3 compatible or Google Cloud Storage data source. Then, you create your shortcut and select that gateway. For more information, see Create shortcuts to on-premises data.
Fabric Spark connector for Fabric Data Warehouse in Spark runtime (preview) The Spark connector for Data Warehouse enables a Spark developer or a data scientist to access and work on data from a warehouse or SQL analytics endpoint of the lakehouse (either from within the same workspace or from across workspaces) with a simplified Spark API.
Fabric Spark Diagnostic Emitter (preview) The Fabric Apache Spark Diagnostic Emitter (preview) allows Apache Spark users to collect logs, event logs, and metrics from their Spark applications and send them to various destinations, including Azure Event Hubs, Azure storage, and Azure log analytics.
Fabric SQL database (Preview) SQL database in Microsoft Fabric (Preview) is a developer-friendly transactional database, based on Azure SQL Database, that allow you to easily create your operational database in Fabric. SQL database in Fabric uses the SQL Database Engine as Azure SQL Database. Review a Decision guide: choose a SQL database.
Folder in Workspace preview As an organizational unit in the workspace, folder addresses this pain point by providing a hierarchical structure for organizing and managing your items. For more information, see Create folders in workspaces.
Iceberg data in OneLake using Snowflake and shortcuts (preview) You can now consume Iceberg-formatted data across Microsoft Fabric with no data movement or duplication, plus Snowflake has added the ability to write Iceberg tables directly to OneLake. For more information, see Use Iceberg tables with OneLake.
Incremental refresh for Dataflow Gen2 (preview) Incremental refresh in Dataflow Gen2 (Preview) is designed to optimize data ingestion and transformation, particularly as your data continues to expand. For more information, see Announcing Preview: Incremental Refresh in Dataflow Gen2.
Invoke remote pipeline (preview) in Data pipeline You can now use the Invoke Pipeline (preview) activity to call pipelines from Azure Data Factory or Synapse Analytics pipelines. This feature allows you to utilize your existing ADF or Synapse pipelines inside of a Fabric pipeline by calling it inline through this new Invoke Pipeline activity.
Lakehouse schemas feature The Lakehouse schemas feature (preview) introduces data pipeline support for reading the schema info from Lakehouse tables and supports writing data into tables under specified schemas. Lakehouse schemas allow you to group your tables together for better data discovery, access control, and more.
Lakehouse support for git integration and deployment pipelines (preview) The Lakehouse now integrates with the lifecycle management capabilities in Microsoft Fabric, providing a standardized collaboration between all development team members throughout the product's life. Lifecycle management facilitates an effective product versioning and release process by continuously delivering features and bug fixes into multiple environments.
Managed virtual networks (preview) Managed virtual networks are virtual networks that are created and managed by Microsoft Fabric for each Fabric workspace.
Microsoft 365 connector now supports ingesting data into Lakehouse (preview) The Microsoft 365 connector now supports ingesting data into Lakehouse tables.
Microsoft Fabric Admin APIs Fabric Admin APIs are designed to streamline administrative tasks. The initial set of Fabric Admin APIs is tailored to simplify the discovery of workspaces, Fabric items, and user access details.
Mirroring in Microsoft Fabric preview With database mirroring in Fabric, you can easily bring your databases into OneLake in Microsoft Fabric, enabling seamless zero-ETL, near real-time insights on your data – and unlocking warehousing, BI, AI, and more. For more information, see What is Mirroring in Fabric?
Native Execution Engine on Runtime 1.3 (preview) Native execution engine for Fabric Runtime 1.3 is now available in preview, offering superior query performance across data processing, ETL, data science, and interactive queries. No code changes are required to speed up the execution of your Apache Spark jobs when using the Native Execution Engine.
Nested common table expressions (CTEs) (preview) Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs. While CTEs are generally available in Microsoft Fabric, nested common table expressions (CTE) in Fabric data warehouse are currently a preview feature.
Notebook debug within vscode.dev (preview) You can now place breakpoints and debug your Notebook code with the Synapse VS Code - Remote extension in vscode.dev. This update first starts with the Fabric Runtime 1.3 (GA).
OneLake data access roles OneLake data access roles for lakehouse are in preview. Role permissions and user/group assignments can be easily updated through a new folder security user interface.
OneLake SAS (preview) Support for short-lived, user-delegated OneLake SAS is now in preview. This functionality allows applications to request a User Delegation Key backed by Microsoft Entra ID, and then use this key to construct a OneLake SAS token. This token can be handed off to provide delegated access to another tool, node, or user, ensuring secure and controlled access.
Open mirroring (Preview) Open mirroring enables any application to write change data directly into a mirrored database in Fabric, based on the open mirroring public APIs and approach. Open mirroring is designed to be extensible, customizable, and open. It's a powerful feature that extends mirroring in Fabric based on open Delta Lake table format. To get started, see Tutorial: Configure Microsoft Fabric open mirrored databases.
Prebuilt Azure AI services in Fabric preview The preview of prebuilt AI services in Fabric is an integration with Azure AI services, formerly known as Azure Cognitive Services. Prebuilt Azure AI services allow for easy enhancement of data with prebuilt AI models without any prerequisites. Currently, prebuilt AI services are in preview and include support for the Microsoft Azure OpenAI Service, Azure AI Language, and Azure AI Translator.
Purview Data Loss Prevention policies have been extended to Fabric lakehouses Extending Microsoft Purview's Data Loss Prevention (DLP) policies into Fabric lakehouses is now in preview.
Purview Data Loss Prevention policies now support the restrict access action for semantic models Restricting access based on sensitive content for semantic models, now in preview, helps you to automatically detect sensitive information as it is uploaded into Fabric lakehouses and semantic models.
Python Notebook (preview) Python Notebooks are for BI Developers and Data Scientists working with smaller datasets using Python as their primary language. To get started, see Use Python experience on Notebook.
Real-Time Dashboards and underlying KQL databases access separation (preview) With separate permissions for dashboards and underlying data, administrators now have the flexibility to allow users to view dashboards without giving access to the raw data.
Reserve maximum cores for jobs (preview) A new workspace-level setting allows you to reserve maximum cores for your active jobs for Spark workloads. For more information, see High concurrency mode in Apache Spark for Fabric.
REST APIs for connections and gateways (preview) REST APIs for connections and gateways are now in preview. These new APIs allow developers to programmatically manage and interact with connections and gateways within Fabric.
REST APIs for Fabric Data Factory pipelines preview The REST APIs for Fabric Data Factory Pipelines are now in preview. Fabric data pipeline public REST API enable you to extend the built-in capability in Fabric to create, read, update, delete, and list pipelines.
Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview) By creating a Fabric Managed Private Endpoint, you can now securely connect Eventstream to your Azure services, such as Azure Event Hubs or IoT Hub, within a private network or behind a firewall. For more information, see Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview).
Semantic model refresh activity (preview) Use the Semantic model refresh activity to refresh a Power BI Dataset (Preview), the most effective way to refresh your Fabric semantic models. For more information, see New Features for Fabric Data Factory Pipelines Announced at Ignite.
Session Expiry Control in Workspace Settings for Notebook Interactive Runs (preview) A new session expiry control in Data Engineering/Science workspace settings allows you to set the maximum expiration time limit for notebook interactive sessions. By default, sessions expire after 20 minutes, but you can now customize the maximum expiration duration.
Share Feature for Fabric AI skill (preview) "Share" capability for the Fabric AI skill (preview) allows you to share the AI Skill with others using a variety of permission models.
Share the Fabric AI skill (preview) Share capability for the Fabric AI skill (preview) allows you to share the AI Skill with others using a variety of permission models.
Spark Run Series Analysis preview The Spark Monitoring Run Series Analysis features allow you to analyze the run duration trend and performance comparison for Pipeline Spark activity recurring run instances and repetitive Spark run activities, from the same Notebook or Spark Job Definition.
Splunk add-on preview Microsoft Fabric add-on for Splunk allows users to ingest logs from Splunk platform into a Fabric KQL DB using the Kusto python SDK.
Tags Tags (preview) help admins categorize and organize data, enhancing the searchability of your data and boosting success rates and efficiency for end users.
Task flows in Microsoft Fabric (preview) The preview of task flows in Microsoft Fabric is enabled for all Microsoft Fabric users. With Task flows (preview), when designing a data project, you no longer need to use a whiteboard to sketch out the different parts of the project and their interrelationships. Instead, you can use a task flow to build and bring this key information into the project itself.
varchar(max) and varbinary(max) support in preview Support for the varchar(max) and varbinary(max) data types in Warehouse is now in preview. For more information, see Announcing public preview of VARCHAR(MAX) and VARBINARY(MAX) types in Fabric Data Warehouse.
Terraform Provider for Fabric (preview) The Terraform Provider for Microsoft Fabric is now in preview. The Terraform Provider for Microsoft Fabric supports the creation and management of many Fabric resources. For more information, see Announcing the new Terraform Provider for Microsoft Fabric.
T-SQL support in Fabric notebooks (preview) The T-SQL notebook feature in Microsoft Fabric (preview) lets you write and run T-SQL code within a notebook. You can use them to manage complex queries and write better markdown documentation. It also allows direct execution of T-SQL on connected warehouse or SQL analytics endpoint. To learn more, see T-SQL support in Microsoft Fabric notebooks.
Warehouse restore points and restore in place You can now create restore points and perform an in-place restore of a warehouse to a past point in time. Restore in-place is an essential part of data warehouse recovery, which allows to restore the data warehouse to a prior known reliable state by replacing or over-writing the existing data warehouse from which the restore point was created.
Warehouse source control (preview) Using Source control with Warehouse (preview), you can manage development and deployment of versioned warehouse objects. You can use SQL Database Projects extension available inside of Azure Data Studio and Visual Studio Code. For more information on warehouse source control, see CI/CD with Warehouses in Microsoft Fabric.
Workspace monitoring (preview) Workspace monitoring is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring.

Generally available features

The following table lists the features of Microsoft Fabric that have recently transitioned from preview to general availability (GA).

Month Feature Learn more
November 2024 Workspace monitoring (preview) Workspace monitoring is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring.
November 2024 OneLake external data sharing (GA) OneLake external data sharing makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant.
November 2024 GraphQL API in Microsoft Fabric GA The API for GraphQL, now generally available, is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL?
November 2024 Real-Time Intelligence: now Generally Available We're excited to announce that Real-Time Intelligence is now generally available (GA). This includes the Real-Time hub, enhanced Eventstream, Eventhouse, Real-Time Dashboards, and Activator. For more information, see What is Real-Time Intelligence?
November 2024 Fabric workload dev kit (GA) The Microsoft Fabric workload development kit is now generally available. This robust developer toolkit is for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs.
November 2024 Mirroring for Azure SQL Database GA With Azure SQL Database mirroring in Fabric, you can easily replicate data from Azure SQL Database into OneLake in Microsoft Fabric.
November 2024 Real-Time hub Real-Time hub is now generally available. For more information, see Introduction to Fabric Real-Time hub.
October 2024 Notebook Git integration Notebook Git integration now supports persisting the mapping relationship of the attached Environment when syncing to new workspace. For more information, see Notebook source control and deployment
October 2024 Notebook in Deployment Pipeline Now you can also use notebooks to deploy your code across different environments, such as development, test, and production. You can also use deployment rules to customize the behavior of your notebooks when they're deployed, such as changing the default Lakehouse of a Notebook. Get started with deployment pipelines, and Notebook shows up in the deployment content automatically.
September 2024 Mirroring for Snowflake With Mirroring for Snowflake in Fabric, you can easily bring your Snowflake data into OneLake. For more information, see Mirroring Snowflake.
September 2024 Copilot for Data Factory Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview.
September 2024 Fast Copy in Dataflow Gen2 The Fast copy feature in Dataflows Gen2 is now generally available. For more information, read Announcing the General Availability of Fast Copy in Dataflows Gen2.
September 2024 Fabric Pipeline Integration in On-premises Data Gateway GA On-premises connectivity for Data pipelines in Microsoft Fabric is now generally available. Learn How to access on-premises data sources in Data Factory for Microsoft Fabric.
September 2024 Data Wrangler for Spark DataFrames Data Wrangler on Spark DataFrames. A notebook-based tool for exploratory data analysis, Data Wrangler works for both pandas DataFrames and Spark DataFrames and arrives at general availability with new usability improvements.
September 2024 Fabric Runtime 1.3 Fabric Runtime 1.3 (GA) includes Apache Spark 3.5, Delta Lake 3.1, R 4.4.1, Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. For more information, see Fabric Runtime 1.3 is Generally Available!.
September 2024 OneLake Shortcuts API REST APIs for OneLake Shortcuts allow programmatic creation and management of shortcuts, now generally available. You can now programmatically create, read, and delete OneLake shortcuts. For example, see Use OneLake shortcuts REST APIs.
September 2024 GitHub integration for source control Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see What is Microsoft Fabric Git integration?
September 2024 OneLake shortcuts to Google Cloud Storage Create a Google Cloud Storage (GCS) shortcut to connect to your existing data through a single unified name space without having to copy or move data. For more information, see Google Cloud Storage shortcuts shortcuts generally available.
September 2024 OneLake shortcuts to S3-compatible data sources Create an S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data. For more information, see S3 compatible shortcuts shortcuts generally available.

For older GA announcements, review the Microsoft Fabric What's New archive.

Community

This section summarizes new Microsoft Fabric community opportunities for prospective and current influencers and MVPs.

Month Feature Learn more
November 2024 Fabric Community Conference in March-April 2025 in Las Vegas Mark your calendars for FabCon Las Vegas from March 31-April 2, 2025. Register and use code MSCUST for a $150 discount! Early Bird pricing ends December 9. Want to share your expertise? Submit your content by December 6!
October 2024 Fabric Influencers Spotlight October 2024 Check out Microsoft MVPs & Fabric Super Users doing amazing work in October 2024 on all aspects of Microsoft Fabric.
October 2024 Microsoft Fabric and AI Learning Hackathon: Copilot in Fabric Part of the Microsoft Fabric and AI Learning Hackathon, read this guide of various capabilities that Copilot offers in Microsoft Fabric, empowering you to enhance productivity and streamline your workflows.
October 2024 Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team is offering 5,000 free DP-600 exam vouchers to eligible Fabric Community members. Complete your exam by the end of the year and join the ranks of certified experts.
October 2024 DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric (beta) The new Microsoft Certified: Fabric Data Engineer Associate certification helps demonstrate your skills with data ingestion, transformation, administration, monitoring, and performance optimization in Fabric. To learn more, see DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric (beta).
October 2024 FabCon Europe 2024 Read a recap of Europe's first Fabric Community Conference and a Recap of Data Factory announcements.
October 2024 Fabric Influencers Spotlight September 2024 The Fabric Influencers Spotlight September 2024 shines a bright light on the places on the internet where Microsoft MVPs & Fabric Super Users are doing some amazing work on all aspects of Microsoft Fabric.
September 2024 Announcing: The Microsoft Fabric & AI Learning Hackathon Get ready for the Microsoft Fabric & AI Learning Hackathon! We're calling all Data/AI Enthusiasts and Data/AI practitioners to join us for another exciting opportunity to upskill and build the next generation of Data + AI solutions with Microsoft Fabric! The Hackathon is open for a seven-week submission period and offers a total of $10,000 in prizes!
August 2024 Fabric Influencers Spotlight August 2024 The Fabric Influencers Spotlight August 2024 highlights and amplifies blog posts, videos, presentations, and other content related to Microsoft Fabric from members of Microsoft MVPs & Fabric Super Users from the Fabric community.
August 2024 Winners of the Fabric Community Sticker Challenge Congratulations to the winners of the Fabric Community Sticker Challenge!

For older updates, review the Microsoft Fabric What's New archive.

Power BI

Important

If you are accessing Power BI on a web browser version older than Chrome 94, Edge 94, Safari 16.4, Firefox 93, or equivalent, you need upgrade your web browser to a newer version by August 31, 2024. Using an outdated browser version after this date can prevent you from accessing features in Power BI.

Updates to Power BI Desktop and the Power BI service are summarized at What's new in Power BI?

Microsoft Copilot in Microsoft Fabric

With Copilot and other generative AI features in preview, Microsoft Fabric brings a new way to transform and analyze data, generate insights, and create visualizations and reports. For more information, see Overview of Copilot in Fabric.

Month Feature Learn more
October 2024 Microsoft Fabric and AI Learning Hackathon: Copilot in Fabric Part of the Microsoft Fabric and AI Learning Hackathon, read this guide of various capabilities that Copilot offers in Microsoft Fabric, empowering you to enhance productivity and streamline your workflows.
October 2024 Use Azure OpenAI to turn whiteboard sketches into data pipelines Read this blog to learn how to turn whiteboard sketches into data pipelines, using the GPT-4o model through Azure OpenAI Service.
September 2024 Creating a real time dashboard by Copilot Copilot can review a table and automatically create a dashboard with insights and a profile of the data with a sample.
September 2024 Copilot in Dataflow Gen2 GA Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview.
September 2024 Copilot for Data Warehouse Copilot for Data Warehouse is now available, offering the Copilot chat pane, quick actions, and code completions. For more information and sample scenarios, see Announcing the Preview of Copilot for Data Warehouse in Microsoft Fabric.

For older updates, review the Microsoft Fabric What's New archive.

Data Factory in Microsoft Fabric

This section summarizes recent new features and capabilities of Data Factory in Microsoft Fabric. Follow issues and feedback through the Data Factory Community Forum.

Month Feature Learn more
December 2024 Data Factory Announcements at Ignite 2024 Recap A couple of weeks ago we had such an exciting week for Fabric during the Ignite Conference, filled with several product announcements and sneak previews of upcoming new features for Data Factory in Fabric.
November 2024 REST APIs for connections and gateways (preview) REST APIs for connections and gateways are now in preview. These new APIs allow developers to programmatically manage and interact with connections and gateways within Fabric.
November 2024 Iceberg format via Azure Data Lake Storage Gen2 Connector in Data pipeline Fabric Data Factory now supports writing data in Iceberg format via Azure Data Lake Storage Gen2 Connector in Data pipeline. For more information, see Iceberg format for Data Factory in Microsoft Fabric.
November 2024 Data Factory Copy Job – CI/CD now available CI/CD for Copy job (preview) in Data Factory in Microsoft Fabric is now available. Copy Job now supports Git Integration and Deployment Pipeline.
November 2024 Semantic model refresh activity (preview) Use the Semantic model refresh activity to refresh a Power BI Dataset (Preview), the most effective way to refresh your Fabric semantic models. For more information, see New Features for Fabric Data Factory Pipelines Announced at Ignite.
November 2024 New connectors for Fabric SQL database In the Data Factory, both data pipeline and Dataflow Gen2 now natively support the SQL database in Fabric (Preview) connector as source and destination. More connector updates for MariaDB, Snowflake, Dataverse, and PostgreSQL also announced.
November 2024 OneLake catalog OneLake data hub has been rebranded as the OneLake catalog in Modern Get Data. When you use Get data inside Pipeline, Copy job, Mirroring and Dataflow Gen2, you'll find the OneLake data hub has been renamed to OneLake catalog.
November 2024 Data pipeline capabilities in Copilot for Data Factory (preview) The new Data pipeline capabilities in Copilot for Data Factory are now available in preview. These features function as an AI expert to help users build, troubleshoot, and maintain data pipelines.
November 2024 Legacy Timestamp Support in Native Execution Engine for Fabric Runtime 1.3 The recent update to Native Execution Engine on Fabric Runtime 1.3 brings support for legacy timestamp handling, allowing seamless processing of timestamp data created by different Spark versions. Read to learn why legacy timestamp support matters.
November 2024 Dataflow Gen2 CI/CD, GIT source control integration and Public APIs support are now in preview With this new set of features, you can now seamlessly integrate your dataflow with your existing CI/CD pipelines and version control of your workspace in Fabric. This integration allows for better collaboration, versioning, and automation of your deployment process across dev, test, and production environments. For more information, see Dataflow Gen2 with CI/CD and Git integration support (preview).
October 2024 New Features and Enhancements for Virtual Network Data Gateway We're excited to announce several powerful updates to the Virtual Network (VNET) Data Gateway, designed to further enhance performance and improve the overall user experience.
October 2024 Recap of Data Factory Announcements at Fabric Community Conference Europe Read a recap of Data Factory announcements from Fabric Community Conference Europe 2024.
September 2024 Copilot in Dataflow Gen2 GA Copilot for Data Factory is now generally available and included in the Dataflow Gen2 experience. For more information, see Copilot for Data Factory overview.
September 2024 Fast Copy in Dataflow Gen2 GA The Fast copy in Dataflows Gen2 is now generally available. For more information, read Announcing the General Availability of Fast Copy in Dataflows Gen2.
September 2024 Incremental refresh for Dataflow Gen2 (preview) Incremental refresh in Dataflow Gen2 (Preview) is designed to optimize data ingestion and transformation, particularly as your data continues to expand. For more information, see Announcing Preview: Incremental Refresh in Dataflow Gen2.
September 2024 Certified connector updates Updated Dataflow Gen2 connectors in Microsoft Fabric have been released, as well as an updated Data pipeline connectors for Salesforce and Vertica. For more information, see the Certified connector updates.
September 2024 Fabric Pipeline Integration in On-premises Data Gateway GA On-premises connectivity for Data pipelines in Microsoft Fabric is now generally available. Learn How to access on-premises data sources in Data Factory for Microsoft Fabric.
September 2024 Invoke remote pipeline (preview) in Data pipeline You can now use the Invoke Pipeline (preview) activity to call pipelines from Azure Data Factory or Synapse Analytics pipelines. This feature allows you to utilize your existing ADF or Synapse pipelines inside of a Fabric pipeline by calling it inline through this new Invoke Pipeline activity.
September 2024 Spark Job environment parameters You can now reuse existing Spark sessions with Session tags. In the Fabric Spark Notebook activity, tag your Spark session, then reuse the existing session using that same tag.
September 2024 Azure Data Factory item in Fabric (preview) You can now bring your existing Azure Data Factory (ADF) to your Fabric workspace. This new preview capability allows you to connect to your existing Azure Data Factory from your Fabric workspace. Select "Create Azure Data Factory" inside of your Fabric Data Factory workspace, and you can manage your Azure data factories directly from the Fabric workspace.
September 2024 Copy job (preview) The Copy job (preview) has advantages over the legacy Copy activity. For more information, see Announcing Preview: Copy Job in Microsoft Fabric. For a tutorial, see Learn how to create a Copy job (preview) in Data Factory for Microsoft Fabric.
September 2024 Lakehouse Connector in Fabric Data Factory introduces Schema Support Fabric Lakehouse supports the creation of custom schemas. When reading from a Lakehouse table with the Lakehouse Connector in Fabric Data Factory, custom schema information is now automatically included.
September 2024 Storage Integration Support in Snowflake Connector for Fabric Data Factory You can now connect Snowflake with external storage solutions (such as Azure Blob Storage) using a secure and centralized approach. For more information, see Snowflake SQL storage integration.
September 2024 New Data Factory Connectors Released in Q3 2024 New Data Factory Connectors include Salesforce, Azure MySQL Database, and Azure Cosmos DB for MongoDB.
August 2024 Certified connector updates Updated Dataflow Gen2 connectors have been released, as well as two new Data pipeline connectors for Salesforce and Vertica. For more information, see the August 2024 Certified connector updates.
August 2024 Data Warehouse Connector Supports TLS 1.3 The Data Warehouse connector now supports TLS 1.3, the latest version of the Transport Layer Security protocol.
August 2024 Connect to your Azure Resources by Modern Get Data Experience in Data pipeline You can easily browse and connect to your Azure resources automatically with the modern data experience of Data Pipeline.

For older updates, review the Microsoft Fabric What's New archive.

Data Factory in Microsoft Fabric samples and guidance

Month Feature Learn more
November 2024 Boosting Data Ingestion in Data Factory: Continuous Innovations in Performance Optimization Here's a closer look at how recent advancements are transforming data ingestion in Data Factory.
November 2024 Copy Job upsert to SQL & overwrite to Fabric Lakehouse The Copy Job simplifies your data ingestion with non-compromising experience from any source to any destination. By default, Copy Job appends data to your destination so that you never miss any change history. However, you can also customize the write behavior to upsert data on Azure SQL Database or SQL Server and overwrite data on Fabric Lakehouse tables, giving you full flexibility to match your needs.
September 2024 Integrate your SAP data into Microsoft Fabric Learn more about an overview of SAP data options in Microsoft Fabric, along with some guidance on the respective use cases.

Fabric Data Engineering

This section summarizes recent new features and capabilities of the Data Engineering workload in Microsoft Fabric.

Month Feature Learn more
December 2024 Python Notebook (preview) Python Notebooks are for BI Developers and Data Scientists working with smaller datasets using Python as their primary language. To get started, see Use Python experience on Notebook.
November 2024 Workspace monitoring (preview) Workspace monitoring is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring.
November 2024 The new OneLake catalog The OneLake catalog is the next evolution of the OneLake data hub. For more information about the new catalog, Discover and explore Fabric items in the OneLake catalog.
November 2024 OneLake external data sharing (GA) OneLake external data sharing, now generally available, makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant.
November 2024 Purview Data Loss Prevention policies now support the restrict access action for semantic models Restricting access based on sensitive content for semantic models, now in preview, helps you to automatically detect sensitive information as it is uploaded into Fabric lakehouses and semantic models.
November 2024 Iceberg data in OneLake using Snowflake and shortcuts (preview) You can now consume Iceberg-formatted data across Microsoft Fabric with no data movement or duplication, plus Snowflake has added the ability to write Iceberg tables directly to OneLake. For more information, see Use Iceberg tables with OneLake.
November 2024 Notebook display chart upgrade The new and improved chart view brings multiple new capabilities to the notebook display. To access the new chart view just open your Fabric notebook and run the display(df) statement.
November 2024 Mirrored databases in Spark Notebooks Mirrored databases in Spark Notebooks allow you to seamlessly explore and run read-only queries on your open-format tables just like Lakehouses, all while taking full advantage of our advanced analytics engines—without the need to migrate any of your data into Fabric.
November 2024 Jar libraries Java Archive (JAR) files are a popular packaging format used in the Java ecosystem, and are now supported in Fabric Environments.
November 2024 Legacy Timestamp Support in Native Execution Engine for Fabric Runtime 1.3 The recent update to Native Execution Engine on Fabric Runtime 1.3 brings support for legacy timestamp handling, allowing seamless processing of timestamp data created by different Spark versions. Read to learn why legacy timestamp support matters.
October 2024 Native Execution Engine available at no additional cost The Native Execution Engine is now available at no additional cost. The Native Execution Engine now supports Fabric Runtime 1.3, which includes Apache Spark 3.5 and Delta Lake 3.2. This upgrade enhances Microsoft Fabric's Data Engineering and Data Science workflows, offering boosts in performance and flexibility.
October 2024 Use OneLake shortcuts to access data across capacities: Even when the producing capacity is paused Learn how OneLake capacity consumption works when accessing data through a shortcut, particularly across capacities.
October 2024 Purview Data Loss Prevention policies have been extended to Fabric lakehouses Extending Microsoft Purview's Data Loss Prevention (DLP) policies into Fabric lakehouses is now in preview.
October 2024 API for GraphQL support for Service Principal Names (SPNs) Service Principal Names (SPN) support for API for GraphQL offers organizations looking to integrate their apps with API for GraphQL in Microsoft Fabric tie seamlessly with their enterprise identity and access management systems. For more information, see Service Principal Names (SPNs) in Fabric API for GraphQL.
October 2024 Automatic code generation in API for GraphQL Fabric API for GraphQL now adds the ability to automatically generate Python and Node.js code based on GraphQL queries tested in the API Explorer.
October 2024 Notebook Git integration GA Notebook Git integration now supports persisting the mapping relationship of the attached Environment when syncing to new workspace. For more information, see Notebook source control and deployment
October 2024 Notebook in deployment pipeline GA Now you can also use notebooks to deploy your code across different environments, such as development, test, and production. You can also use deployment rules to customize the behavior of your notebooks when they're deployed, such as changing the default Lakehouse of a Notebook. Get started with deployment pipelines, and Notebook shows up in the deployment content automatically.
October 2024 Notebook in Org APP The Notebook feature is now supported in Org APP. You can easily embed Notebook code and markdown cells, visuals, tables, charts, and widgets in OrgAPP, as a practical storytelling tool.
October 2024 Notebook onboarding tour The new Fabric Notebook Onboarding Tour is now available. This guided tour is designed to help you get started with the essential Notebook features and learn the new capabilities.
October 2024 Notebook mode switcher The Notebook mode switcher provides flexible access modes (Develop, Run Only, Edit, View) for your notebooks, which can help you easily manage the permissions to the notebook and the corresponding view.
October 2024 Free selection support on display() table view The free selection function on the rich dataframe preview in the notebook can improve the data analysis experience. To see the new features, read Free selection support on display() table view.
October 2024 Filter, sort and search your Lakehouse objects Sorting, Filtering, and Searching capabilities make data exploration and analysis more efficient by allowing you to quickly retrieve the information you need based on specific criteria, right within the Lakehouse environment.
September 2024 Fabric Runtime 1.3 GA Fabric Runtime 1.3 (GA), now generally available, includes Apache Spark 3.5, Delta Lake 3.1, R 4.4.1, Python 3.11, support for Starter Pools, integration with Environment, and library management capabilities. For more information, see Fabric Runtime 1.3 is Generally Available!.
September 2024 Native Execution Engine on Runtime 1.3 (preview) Native execution engine for Fabric Spark for Fabric Runtime 1.3 is now available in preview, offering superior query performance across data processing, ETL, data science, and interactive queries. No code changes are required to speed up the execution of your Apache Spark jobs when using the Native Execution Engine.
September 2024 High concurrency mode for Notebooks in Pipelines (preview) High concurrency mode for Notebooks in Pipelines enables users to share Spark sessions across multiple notebooks within a pipeline. With high concurrency mode, users can trigger pipeline jobs, and these jobs are automatically packed into existing high concurrency sessions.
September 2024 Reserve maximum cores for jobs (preview) A new workspace-level setting allows you to reserve maximum cores for your active jobs for Spark workloads. For more information, see High concurrency mode in Apache Spark for Fabric.
September 2024 Session Expiry Control in Workspace Settings for Notebook Interactive Runs (preview) A new session expiry control in Data Engineering/Science workspace settings allows you to set the maximum expiration time limit for notebook interactive sessions. By default, sessions expire after 20 minutes, but you can now customize the maximum expiration duration.
September 2024 Fabric Spark Diagnostic Emitter (preview) The Fabric Apache Spark Diagnostic Emitter (preview) allows Apache Spark users to collect logs, event logs, and metrics from their Spark applications and send them to various destinations, including Azure Event Hubs, Azure Storage, and Azure Log Analytics.
September 2024 Environment integration with Synapse VS Code extension You can now create, configure, and use an environment in Fabric in VS Code with the Synapse VS Code extension.
September 2024 Notebook debug within vscode.dev (preview) You can now place breakpoints and debug your Notebook code with the Synapse VS Code - Remote extension in vscode.dev. This update first starts with the Fabric Runtime 1.3.
September 2024 Invoke Fabric User Data Functions in Notebook You can now invoke User Defined Functions (UDFs) in your PySpark code directly from Microsoft Fabric Notebooks or Spark jobs. With NotebookUtils integration, invoking UDFs is as simple as writing a few lines of code.
September 2024 Functions Hub The new Functions Hub provides a single location to view, access, and manage your User Data Functions.
September 2024 Support for spaces in Lakehouse Delta table names You can now create and query Delta tables with spaces in their names, such as "Sales by Region" or "Customer Feedback". All Fabric Runtimes and Spark authoring experiences support table names with spaces.
September 2024 Enable/Disable Functionality in API for GraphQL The Enable/Disable feature for queries and mutations in GraphQL API provides administrators and developers with granular control over API access and usage.
September 2024 Public REST API of Livy endpoint The Fabric Livy endpoint lets users submit and execute their Spark code on the Spark compute within a designated Fabric workspace, eliminating the need to create any Notebook or Spark Job Definition.
September 2024 OneLake SAS (preview) Support for OneLake SAS is now in preview. This functionality allows applications to request a User Delegation Key backed by Microsoft Entra ID, and then use this key to construct a short-lived, user-delegated OneLake SAS token. This token can be handed off to provide delegated access to another tool, node, or user, ensuring secure and controlled access.
September 2024 Access Databricks Unity Catalog tables from Fabric (preview) A mirrored Azure Databricks Unity Catalog in Fabric allows you to read data managed by Unity Catalog from Fabric workloads from the Lakehouse. In Fabric, you can now create a new data item called "Mirrored Azure Databricks Catalog". For more information, see Databricks Unity Catalog tables available in Microsoft Fabric.
September 2024 T-SQL support in Fabric notebooks The T-SQL notebook feature in Microsoft Fabric lets you write and run T-SQL code within a notebook. You can use them to manage complex queries and write better markdown documentation. It also allows direct execution of T-SQL on connected warehouse or SQL analytics endpoint. To learn more, see T-SQL support in Microsoft Fabric notebooks.
September 2024 OneLake shortcuts to Google Cloud Storage Now a generally available feature, Create a Google Cloud Storage (GCS) shortcut to connect to your existing data through a single unified name space without having to copy or move data.
September 2024 OneLake shortcuts to S3-compatible data sources Now a generally available feature, Create an S3 compatible shortcut to connect to your existing data through a single unified name space without having to copy or move data.
August 2024 MsSparkUtils upgrade to NotebookUtils The library MsSparkUtils has been rebranded as NotebookUtils. While NotebookUtils is backward compatible with MsSparkUtils, new features will only be added to the NotebookUtils namespace. For more information, see NotebookUtils (former MSSparkUtils) for Fabric.
August 2024 Import Notebook UX improvement The Import Notebook feature user interface has been enhanced - you can now effortlessly import notebooks, reports, or paginated reports using the unified entry in the workspace toolbar.
August 2024 Lifecycle of Apache Spark runtimes in Fabric The Lifecycle of Apache Spark runtimes in Fabric document details the release cadence and versioning for the Azure-integrated platform based on Azure Spark. For more information, see the Fabric runtime lifecycle blog post.

For older updates, review the Microsoft Fabric What's New archive.

Fabric Data Engineering samples and guidance

Month Feature Learn more
December 2024 Troubleshooting Fabric Spark application without production workspace access You have Fabric Spark Notebooks deployed in a production workspace, but you don't have direct access to it. The production support team reports that a Fabric Spark job has failed in the production workspace, and you need to analyze the logs to troubleshoot the issue. To troubleshoot Spark applications, Spark engineers typically use the Spark UI, which provides details of Jobs, Stages, Storage, Environment, Executors, and SQL.
October 2024 Optimizing Spark Compute for Medallion Architectures in Microsoft Fabric Learn how to optimize Spark Compute for Medallion architecture: a popular data engineering approach that emphasizes modularity. It organizes the data platform into three distinct layers: Bronze, Silver, and Gold.
August 2024 Build a custom Sparklens JAR In this blog, learn how to build the sparklens JAR for Spark 3.X, which can be used in Microsoft Fabric.

Fabric Data Science

This section summarizes recent improvements and features for Data Science in Microsoft Fabric.

Month Feature Learn more
December 2024 Python Notebook (preview) Python Notebooks are for BI Developers and Data Scientists working with smaller datasets using Python as their primary language. To get started, see Use Python experience on Notebook.
November 2024 Low code AutoML user experience in Fabric (preview) AutoML, or Automated Machine Learning, is a process that automates the time-consuming and complex tasks of developing machine learning models. The new low code AutoML experience supports a variety of tasks, including regression, forecasting, classification, and multi-class classification. To get started, Create models with Automated ML (preview).
October 2024 Enhancing Open Source: Fabric's Contributions to FLAML for Scalable AutoML We have focused on enhancing FLAML's capabilities for Spark workloads. We've contributed several new Spark and non-Spark estimators to the FLAML project. Try these out with AutoML in Fabric (preview).
September 2024 Data Wrangler for Spark DataFrames GA Data Wrangler is now generally available. A notebook-based tool for exploratory data analysis, Data Wrangler works for both pandas DataFrames and Spark DataFrames and arrives at general availability with new usability improvements.
September 2024 Share Feature for Fabric AI skill (preview) "Share" capability for the Fabric AI skill (preview) allows you to share the AI Skill with others using a variety of permission models.
September 2024 Session Expiry Control in Workspace Settings for Notebook Interactive Runs (preview) A new session expiry control in Data Engineering/Science workspace settings allows you to set the maximum expiration time limit for notebook interactive sessions. By default, sessions expire after 20 minutes, but you can now customize the maximum expiration duration.
September 2024 File editor in Notebook The file editor feature in Fabric Notebook allows users to view and edit files directly within the notebook's resource folder and environment resource folder in notebook. Supported file types include CSV, TXT, HTML, YML, PY, SQL, and more.
August 2024 Apply MLFlow tags on ML experiment runs and model versions You can now apply MLflow tags directly on ML experiment runs and ML model versions from the user interface.
August 2024 Track related ML Experiment runs in your Spark Application You can now use an enhancement to the Monitoring Hub to track related ML experiment runs within Spark applications. You can also integrate Experiment items into the Monitoring Hub.
August 2024 Use PREDICT with Fabric AutoML models You can now move from training with AutoML to making predictions by using the built-in Fabric PREDICT UI and code-first APIs for batch predictions. For more information, see Machine learning model scoring with PREDICT in Microsoft Fabric.
August 2024 Data Science AI skill (preview) You can now build your own generative AI experiences over your data in Fabric with the AI skill (preview)! You can build question and answering AI systems over your Lakehouses and Warehouses. For more information, see Introducing AI Skills in Microsoft Fabric: Now in Preview. To get started, try AI skill example with the AdventureWorks dataset (preview).

For older updates, review the Microsoft Fabric What's New archive.

Fabric Data Science samples and guidance

Month Feature Learn more
September 2024 Using Microsoft Fabric for Generative AI: A Guide to Building and Improving RAG Systems This tutorial includes three main notebooks, each covering a crucial aspect of building and optimizing RAG systems in Microsoft Fabric.
September 2024 Harness Microsoft Fabric AI Skill to Unlock Context-Rich Insights from Your Data This post demonstrates how you can extend the capabilities of Fabric AI Skill in Microsoft Fabric notebooks to deliver richer and more comprehensive responses using additional Large Language Model (LLM) queries.

Fabric Databases

This section summarizes recent improvements and features for Microsoft Fabric Databases.

Tip

Sign up for the Learn Together: SQL database in Fabric series Microsoft Reactor Livestream, available in two time zones, in December 2024.

Month Feature Learn more
November 2024 New connectors for Fabric SQL database In the Data Factory, both data pipeline and Dataflow Gen2 now natively support the Fabric SQL database connector as source and destination. For more information, see Fabric SQL Database Connector.
November 2024 Fabric SQL database (Preview) SQL database in Microsoft Fabric is a developer-friendly transactional database, based on Azure SQL Database, that allow you to easily create your operational database in Fabric. A SQL database in Fabric uses the SQL Database Engine as Azure SQL Database. Review a Decision Guide for SQL databases. For more on this announcement, read the SQL database in Fabric announcement blog.

Fabric Database samples and guidance

Month Feature Learn more
December 2024 Tour the Query Editor in SQL database in Microsoft Fabric Whether you're a seasoned data professional or a developer new to SQL, the query editor offers features that cater to all skill levels. For more information, see Query with the SQL query editor.
November 2024 Building a Smart Chatbot with SQL Database in Microsoft Fabric, LangChain and Chainlit Imagine you're the founder of Contoso, a rapidly growing e-commerce startup. As your online store grows, you realize that many customer inquiries are about basic product information: price, availability, and specific features. To automate these routine questions, you decide to build a chatbot with SQL Database in Microsoft Fabric, LangChain and Chainlit.
November 2024 Learning pathways for SQL database For those curious about where to learn more and how to try out this new offering, read more about the upcoming episodes of SQL database in Microsoft Fabric: Learn Together.
November 2024 Data Exposed: Announcing SQL database in Microsoft Fabric preview Watch a Data Exposed video introducing on the SQL database in Microsoft Fabric public preview.
November 2024 Guided application tutorial in Fabric SQL database The tutorial provides a comprehensive guide to utilizing the SQL database in Fabric. This tutorial is tailored to help you navigate through the process of database creation, setting up database objects, exploring autonomous features, and combining and visualizing data. Additionally, learn how to create a GraphQL endpoint, which serves as a modern approach to connecting and querying your data efficiently.
November 2024 Get started with Fabric SQL database Guided how-to documents on how to do basic tasks in SQL database in Fabric start with Enable SQL database in Fabric using Admin Portal tenant settings.

Fabric Data Warehouse

This section summarizes recent improvements and features for Fabric Data Warehouse.

Month Feature Learn more
December 2024 What's new in the Fabric SQL analytics endpoint? There are several updates to improve both functionality and user experience with the SQL analytics endpoint, including metadata sync, last successful update, improved error propagation, and more.
November 2024 Open mirroring (Preview) Open mirroring enables any application to write change data directly into a mirrored database in Fabric, based on the open mirroring public APIs and approach. Open mirroring is designed to be extensible, customizable, and open. It is a powerful feature that extends mirroring in Fabric based on open Delta Lake table format. To get started, see Tutorial: Configure Microsoft Fabric open mirrored databases.
November 2024 Data Warehouse: Copilot & AI Skill Learn how the Copilot tools for Fabric Data Warehouse differ, when to use each, and how they can work together to maximize productivity and deliver insights with Fabric Warehouse.
November 2024 Fabric Mirroring for Azure SQL Managed Instance (Preview) Fabric Database mirroring is now able to mirror Azure SQL Managed Instance databases.
November 2024 Mirroring for Azure SQL Database GA With Azure SQL Database mirroring in Fabric, you can easily bring your database into OneLake in Microsoft Fabric.
October 2024 Case insensitive collation support By default, the collation of a warehouse is case sensitive (CS) with 'Latin1_General_100_BIN2_UTF8'. You can now Create a warehouse with case-insensitive (CI) collation.
October 2024 varchar(max) and varbinary(max) support in preview Support for the varchar(max) and varbinary(max) in data types in Warehouse is now in preview. For more information, see Announcing public preview of VARCHAR(MAX) and VARBINARY(MAX) types in Fabric Data Warehouse.
October 2024 Concurrency performance improvements We have recently optimized our task scheduling algorithm in our distributed query processing engine (DQP) to reduce contention when the workspace is under moderate to heavy concurrency. In testing we have observed that this optimization makes significant performance improvements in querying workloads.
October 2024 JSON support enhancements JSON functionalities in warehouse and SQL analytics endpoints for Lakehouse and mirrored databases have been improved. For details see, JSON support enhancements.
October 2024 Nested Common Table Expressions (CTEs) (preview) Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs. While CTEs are generally available in Microsoft Fabric, nested common table expressions (CTE) in Fabric data warehousing (Transact-SQL) are currently a preview feature.
September 2024 Mirroring for Snowflake GA With Mirroring for Snowflake in Fabric, you can easily bring your Snowflake data into OneLake in Microsoft Fabric. For more information, see Mirroring Snowflake.
September 2024 Copilot for Data Warehouse Copilot for Data Warehouse (preview) is now updated and available as a preview feature, offering the Copilot chat pane, quick actions, and code completions.
September 2024 Delta column mapping in the SQL analytics endpoint SQL analytics endpoint now supports Delta tables with column mapping enabled. For more information, see Delta column mapping and Limitations of the SQL analytics endpoint. This feature is currently in preview.
September 2024 Lakehouse schemas in SQL analytics endpoint Lakehouse schemas allow delta tables in schemas to be queried in the SQL analytics endpoint. For more information, see Lakehouse schemas feature (preview).
September 2024 Fabric Spark connector for Fabric Data Warehouse new features (preview) The Fabric Spark connector for Fabric Data Warehouse (preview) now supports custom or pass-through queries, PySpark, and Fabric Runtime 1.3 (Spark 3.5).
September 2024 New editor improvements Editor improvements for Warehouse and SQL analytics endpoint items improve the consistency and efficiency. For more information, see New editor improvements.
September 2024 T-SQL support in Fabric notebooks (preview) The T-SQL notebook feature in Microsoft Fabric (preview) lets you write and run T-SQL code within a notebook. You can use them to manage complex queries and write better markdown documentation. It also allows direct execution of T-SQL on connected warehouse or SQL analytics endpoint. To learn more, see T-SQL support in Microsoft Fabric notebooks.
September 2024 Nested Common Table Expressions (CTEs) (preview) Fabric Warehouse and SQL analytics endpoint both support standard, sequential, and nested CTEs. While CTEs are generally available in Microsoft Fabric, nested common table expressions (CTE) in warehouse are currently a preview feature.
September 2024 Mirrored Azure Databricks (Preview) A mirrored Azure Databricks Unity Catalog in Fabric allows you to read data managed by Unity Catalog from Fabric workloads from the Lakehouse. For more information, see Databricks Unity Catalog tables available in Microsoft Fabric.
August 2024 Mirroring integration with modern get data experience You can now use the Modern Get Data experience to choose from all the available mirrored databases in OneLake.
August 2024 T-SQL DDL support in Azure SQL Database mirrored database You can now run DDL operations on a Azure SQL Database mirrored database such as Drop Table, Rename Table, and Rename Column.
August 2024 Delta Lake log publishing pause and resume You can now pause and resume the publishing of Delta Lake Logs for Warehouses. For more information, see Delta Lake logs in Warehouse in Microsoft Fabric.
August 2024 Managing V-Order behavior of Fabric Warehouses You can now manage V-Order behavior at the warehouse level. For more information, see Understand V-Order for Microsoft Fabric Warehouse.
August 2024 TRUNCATE T-SQL support The TRUNCATE T-SQL command is now supported in Warehouse tables.

For older updates, review the Microsoft Fabric What's New archive.

Fabric Data Warehouse samples and guidance

Month Feature Learn more
November 2024 SQL to Microsoft Fabric Migration: Beginner-Friendly Strategies for a Smooth Transition Learn more about migrating your SQL database to Microsoft Fabric, a unified platform that brings your data and analytics together effortlessly.
October 2024 Ensuring Data Continuity in Fabric Warehouse: Best Practices for Every Scenario Dive deep into the common recovery scenarios and features that help enable seamless end-to-end data recovery and discuss best practices to ensure data resilience.
August 2024 Mirroring SQL Server database to Fabric While SQL Server isn't currently supported for Fabric mirrored databases, learn how to extend Fabric mirroring to an on-premises SQL Server database as a source, using a combination of SQL Server Transactional replication and Fabric Mirroring.

Real-Time Intelligence in Microsoft Fabric

This section summarizes recent improvements and features for Real-Time Intelligence in Microsoft Fabric.

Month Feature Learn more
December 2024 Eventhouse Query Acceleration for OneLake Shortcuts (Preview) Query Acceleration for OneLake Shortcuts in Eventhouse speeds up ad hoc queries over data in OneLake. OneLake shortcuts are references from an Eventhouse that point to internal Fabric or external sources. Previously, queries run over OneLake shortcuts were less performant than on data that is ingested directly to Eventhouses due to various factors.
November 2024 New event categories in Fabric Real-Time Hub New event categories in Real-Time Hub include: OneLake events, Job events, and Capacity utilization events. These new event categories are currently in preview. For more information, see Unlocking the power of Real-Time Data with OneLake Events.
November 2024 Eventstream processing and routing events to Activator (preview) Now, Eventstream supports processing and transforming events with business requirements before routing the events to the destination: Activator. When these transformed events reach Activator, you can establish rules or conditions for your alerts to monitor the events.
November 2024 REST APIs for Fabric Eventstream With the Eventstream REST API, you can now programmatically create, manage, and update Eventstream items. For more information, see Fabric REST APIs for Eventstream.
November 2024 Real-Time Intelligence: now Generally Available We are excited to announce that Real-Time Intelligence is now generally available (GA). This includes the Real-Time hub, enhanced Eventstream, Eventhouse, Real-Time Dashboards, and Activator. For more information, see What is Real-Time Intelligence?
November 2024 Real-Time hub Real-Time hub is now generally available. For more information, see Introduction to Fabric Real-Time hub.
November 2024 Eventstream support for Azure Service Bus and Activator Eventstreams support Azure Service Bus source (preview) and Fabric activator destination (preview) now, and they are in preview. The following connectors are generally available now: PostgreSQL Database (DB) Change Data Capture (CDC), MySQL DB CDC, Cosmos DB CDC, Azure SQL DB CDC, Azure SQL Managed Instance DB CDC, SQL Server on virtual machine DB CDC, Google Pub/Sub, Amazon Kinesis Data Streams, Apache Kafka, Confluent Cloud Kafka, and Amazon Managed Streaming for Apache Kafka. Eventstreams support Git Integration and Deployment Pipeline by integrating with Git and deployment pipelines.
October 2024 Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview) By creating a Fabric Managed Private Endpoint, you can now securely connect Eventstream to your Azure services, such as Azure Event Hubs or IoT Hub, within a private network or behind a firewall. For more information, see Secure Data Streaming with Managed Private Endpoints in Eventstream (Preview).
October 2024 Usage reporting for Activator is now live The Activator team has rolled out usage reporting to help you better understand your capacity consumption and future charges. When you look at the Capacity metrics app compute page you'll now see operations for the reflex items included.
October 2024 Real-Time Dashboards and underlying KQL databases access separation (preview) With separate permissions for dashboards and underlying data, administrators now have the flexibility to allow users to view dashboards without giving access to the raw data.
October 2024 Real-Time Dashboards Integration with GitHub Fabric's Git integration is now available for Real-Time Dashboards. For more information, see What is Microsoft Fabric Git integration?
October 2024 Quickly visualize query results in KQL Queryset You can now graphically visualize KQL Queryset results instantly and effortlessly and control the formatting without the need for re-run queries – all using a familiar UI.
October 2024 Pin query to dashboard You can now save the outcome of any query written in KQL Queryset directly to a new or existing Real-Time Dashboard.
September 2024 Creating a real time dashboard by Copilot Copilot can review a table and automatically create a dashboard with insights and a profile of the data with a sample.
September 2024 New Real-Time hub and KQL Database user experiences The new user experience features new Real-Time hub navigation, a My Streams page, an enhanced database page experience, and more.
September 2024 Eventhouse as a new Destination in Eventstream Eventhouses, equipped with KQL Databases, can handle and analyze large volumes of data. With the Eventhouse destination in Eventstream, you can efficiently process and route data streams into an Eventhouse and analyze the data in near real-time using KQL.
September 2024 Managed private endpoints for Eventstream With a managed private endpoints for Fabric, you can now establish a private connection between your Azure services, such as Azure Event Hubs, and Fabric Eventstream. For more information, see Eventstream integration with managed private endpoint.
September 2024 Activator alerts on KQL Querysets Now you can set up Activator (preview) alerts directly on your KQL queries in KQL querysets. For more information and samples, see Create Activator alerts from a KQL Queryset.
September 2024 Real-Time Dashboards continuous or 10s refresh rate The dashboard auto refresh feature now supports continuous and 10 second refresh rates, in addition to the existing options. This upgrade, addressing a popular customer request, allows both editors and viewers to set near real-time and real-time data updates.
September 2024 Multivariate anomaly detection A new workflow for multivariate anomaly detection of time series data is based on the algorithm that is used in the AI Anomaly Detector service (which is being retired as a standalone service). For a tutorial, see Multivariate Anomaly Detection.
September 2024 Real-Time Intelligence Copilot conversational mode The Copilot assistant, which translates natural language into KQL, now supports conversational mode, allowing you to ask follow-up questions that build on previous queries within the chat.
September 2024 New connectors and UI in Real-Time hub Four new connectors released on September 24, 2024: Apache Kafka, Amazon Managed Streaming for Apache Kafka, Azure SQL Managed Instance CDC, SQL Server on VM DB CDC. The tabs in the main page of Real-Time hub are replaced with menu items on the left navigation menu. For more information, see Get started with Fabric Real-Time hub. You can connect to Azure streaming sources using private endpoints now.
September 2024 Announcement: Eventhouse Standard Storage billing Starting the week of September 16 you will start seeing billable consumption of the OneLake Storage Data Stored meter from the Eventhouse and KQL Database items.
August 2024 Fabric Real-Time hub Teaching Bubbles New teaching bubbles provide a step-by-step guide through its major functionalities. These interactive guides allow you to seamlessly navigate each tab of the Real-Time hub. For more information, see Fabric Real-Time hub Teaching Bubble.
August 2024 KQL Queryset REST API support The new Fabric Queryset REST APIs allow you to create/update/delete KQL Querysets in Fabric, and programmatically manage them without manual intervention. For more information, see KQL Queryset REST API support.

For older updates, review the Microsoft Fabric What's New archive.

Real-Time Intelligence samples and guidance

Month Feature Learn more
December 2024 Understanding Real-Time Intelligence usage reporting and billing Learn about Real-Time Intelligence Eventstream, Eventhouse, storage, Fabric Events and Activator consumption utilization, capacity meters, and costs.
August 2024 Advanced Time Series Anomaly Detector in Fabric Read an example using the time-series-anomaly-detector in Fabric to upload stocks change table to Fabric, train the multivariate anomaly detection model in a Python notebook using Spark engine, and predict anomalies by applying the trained model to new data using Eventhouse (Kusto) engine.
August 2024 Acting on Real-Time data using custom actions with Activator Learn how to monitor and acting on data is to use Activator, which is a no-code experience in Microsoft Fabric for taking action automatically when the condition of the package temperature is detected in the data.

Microsoft Fabric core features

News and feature announcements core to the Microsoft Fabric experience.

Month Feature Learn more
November 2024 Workspace monitoring (preview) Workspace monitoring (preview) is a Microsoft Fabric database that collects data from a range of Fabric items in your workspace, and lets users access and analyze logs and metrics. For more about this feature, see Announcing preview of workspace monitoring.
November 2024 OneLake external data sharing (GA) External data sharing in Microsoft Fabric, now generally available, makes it possible for Fabric users to share data from within their Fabric tenant with users in another Fabric tenant.
November 2024 GraphQL API in Microsoft Fabric GA The API for GraphQL, now generally available, is a data access layer that allows us to query multiple data sources quickly and efficiently in Fabric. For more information, see What is Microsoft Fabric API for GraphQL?
November 2024 The new OneLake catalog The OneLake catalog is the next evolution of the OneLake data hub. For more information about the new catalog, Discover and explore Fabric items in the OneLake catalog.
November 2024 Fabric workload dev kit (GA) The Microsoft Fabric workload development kit is now generally available. This robust developer toolkit is for designing, developing, and interoperating with Microsoft Fabric using frontend SDKs and backend REST APIs.
November 2024 Domains in Fabric – new enhancements Review new features and use cases for Domains in Fabric, including Best practices for planning and creating domains in Microsoft Fabric.
October 2024 New Item panel in Workspace Previously, by selecting +New in the workspace, you can access a dropdown menu with some pre-defined item types to get started. Now, the +New item button shows item types listed in a panel, categorized by tasks.
October 2024 Enhanced Tenant Setting Delegation for Export Controls Delegation of export settings is now available to workspaces via domain. This new capability provides more granular control over data export permissions, addressing the specific needs of tenant, domain and workspace administrators.
October 2024 APIs for Managed Private Endpoint are now available REST APIs for managed Private Endpoints are available. You can now create, delete, get, list Managed private endpoints via APIs.
October 2024 Important billing updates coming to Copilot and AI in Fabric Upcoming pricing and billing updates to make Copilot and AI features in Fabric more accessible and cost-effective.
September 2024 Terraform Provider for Fabric (preview) The Terraform Provider for Microsoft Fabric is now in preview. The Terraform Provider for Microsoft Fabric supports the creation and management of many Fabric resources. For more information, see Announcing the new Terraform Provider for Microsoft Fabric.
September 2024 Announcing Service Principal support for Fabric APIs You can now use service principal to access Fabric APIs. Service principal is a security identity that you can create in Microsoft Entra and assign permissions to it in Microsoft Entra and other Microsoft services, such as Microsoft Fabric.
September 2024 Tag your data to enrich item curation and discovery Tags (preview) help admins categorize and organize data, enhancing the searchability of your data and boosting success rates and efficiency for end users.
September 2024 Trusted workspace access and Managed private endpoints in any Fabric capacity Trusted workspace access and Managed private endpoints are available in any Fabric capacity. Previously, trusted workspace access and Managed private endpoints were available only in F64 or higher capacities. Managed Private endpoints are now available in Trial capacities.
September 2024 Multitenant organization (MTO) (preview) Fabric now supports Microsoft Entra ID Multitenant Organizations (MTO). The multitenant organizations capability in Microsoft Entra ID synchronizes users across multiple tenants, adding them as users of type external member. For more information, see Distribute Power BI content to external guest users with Microsoft Entra B2B.
September 2024 Microsoft Fabric Achieves HITRUST CSF Certification Microsoft Fabric is now certified for the HITRUST Common Security Framework (CSF) v11.0.1.
August 2024 OneLake data access role improvements Based on key feedback, we've updated data access roles with a user interface redesign. For more information, see Get started with OneLake data access roles (preview).
August 2024 Workspace filter improvement to support nested folders We have upgraded the filter experience to support filtering through the entire workspace or through a specific folder with all its nested folders.
August 2024 Announcing the availability of Trusted workspace access and Managed private endpoints in any Fabric capacity Use Trusted workspace access and Managed Private endpoints in Fabric with any F capacity and enjoy the benefits of secure and optimized data access and connectivity.

For older updates, review the Microsoft Fabric What's New archive.

Continuous Integration/Continuous Delivery (CI/CD) in Microsoft Fabric

This section includes guidance and documentation updates on development process, tools, source control, and versioning in the Microsoft Fabric workspace.

Month Feature Learn more
November 2024 Microsoft Fabric REST APIs Integration with GitHub These APIs enable you to automate Git integration tasks, such as connecting to GitHub, retrieving connection details, committing changes to your connected GitHub repository, updating from the repository, and more. For more information, see Automate Git integration by using APIs and code samples.
November 2024 Data Factory Copy Job – CI/CD now available CI/CD for Copy job (preview) in Data Factory in Microsoft Fabric is now available. Copy Job now supports Git Integration and Deployment Pipeline.
September 2024 GitHub integration for source control Now generally available, Fabric developers can now choose GitHub or GitHub Enterprise as their source control tool, and version their Fabric items there. For more information, see What is Microsoft Fabric Git integration?
September 2024 New Deployment Pipelines design A new and improved design for the Deployment Pipeline introduces a range of changes, additions, and improvements designed to elevate your deployment process. Read more about What's changed in deployment pipelines.

For older updates, review the Microsoft Fabric What's New archive.

Continuous Integration/Continuous Delivery (CI/CD) samples

Month Feature Learn more
August 2024 Exploration of Microsoft Fabric's CI/CD Features A guided tour of Microsoft Fabric's CI/CD features for data pipelines, lakehouse, notebooks, reports, and semantic models.

Archive

For older updates, review the Microsoft Fabric What's New archive.

Related content