Edit

Share via

Add Azure SQL Database Change Data Capture (CDC) as source in Real-Time hub

  • Article

This article describes how to get events from Azure SQL Database Change Data Capture (CDC) into Fabric Real-Time hub. The Azure SQL Database CDC source connector allows you to capture a snapshot of the current data in an Azure SQL database. The connector then monitors and records any future row-level changes to this data.

Prerequisites

  • Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
  • A running Azure SQL server with an Azure SQL database.
  • Membership in the sysadmin fixed server role for the SQL Server, and db_owner role on the database.
  • CDC enabled on your Azure SQL database by running the stored procedure sys.sp_cdc_enable_db. For details, see Enable and disable change data capture.

Note

  • Mirroring shouldn't be enabled in your database.
  • Multiple tables CDC isn't supported.

Get events from an Azure SQL Database CDC

You can get events from an Azure SQL Database CDC into Real-Time hub in one of the ways:

Data sources page

  1. Sign in to Microsoft Fabric.

  2. Select Real-Time on the left navigation bar.

  3. On the Real-Time hub page, select + Data sources under Connect to on the left navigation menu. You can also get to the Data sources page from All data streams or My data streams pages by selecting the + Connect data source button in the top-right corner.

    Screenshot that shows how to launch Connect to data source experience.

  1. On the Data sources page, select Microsoft sources category at the top, and then select Connect on the Azure SQL DB (CDC) tile.

    Screenshot that shows the selection of Azure SQL Database (CDC) as the source type in the Data sources page.

    Use instructions from the Connect to an Azure SQL Database CDC source section.

Microsoft sources page

  1. In Real-Time hub, select Microsoft sources on the left navigation menu. You can use the search box to the type your resource name or use filters (Source, Subscription, Resource group, Region) to search for your resource.

  2. In the Source drop-down list, select Azure SQL DB (CDC).

  3. For Subscription, select an Azure subscription that has the resource group with your SQL database.

  4. For Resource group, select a resource group that has your SQL database.

  5. For Region, select a location where your SQL database is located.

  6. Now, move the mouse over the name of the SQL database that you want to connect to Real-Time hub in the list of databases, and select the Connect button, or select ... (ellipsis), and then select the Connect button.

    Screenshot that shows the Microsoft sources page with filters to show SQL databases and the connect button for an Azure SQL database.

Connect to an Azure SQL Database CDC source

  1. On the Connect page, select New connection.

    Screenshot that shows the Connect page of the Data sources page with the **New connection** link highlighted.

    If you have an existing connection to your Azure SQL Database CDC source, you can select it from the Connection drop-down list, and move on to configuring port and tables.

    Screenshot that shows the Connect page with an existing connection selected.

  2. In the Connection settings section, enter the following values for your Azure SQL database:

    • Server: Enter the Azure SQL server name from the Azure portal.

    • Database: Enter the Azure SQL database name from the Azure portal.

      Screenshot that shows the Connection settings section of the New connection page.

  3. Scroll down, and in the Connection credentials section, follow these steps.

    1. For Connection name, enter a name for the connection.

    2. For Authentication kind, select Basic.

      Note

      Currently, Fabric eventstreams supports only Basic authentication.

    3. Enter Username and Password for the database.

    4. Select Connect.

      Screenshot that shows the Connection credentials section of the New connection page.

  4. Now, on the Connect page, do these steps:

    1. Select All tables or enter the table names separated by commas, such as: dbo.table1, dbo.table2.

    2. For Port, the default value is 1433 and can't be modified.

    3. In the Stream details section to the right, select the Fabric workspace where you want to save the eventstream that the Wizard is going to create.

    4. For eventstream name, enter a name for the eventstream. The wizard creates an eventstream with the selected Azure SQL Database CDC as a source.

    5. The Stream name is automatically generated for you by appending -stream to the name of the eventstream. You can see this stream on the Real-time hub All data streams page when the wizard finishes.

    6. Select Next.

      Screenshot that shows the filled Add source wizard Connect page.

  5. On the Review + connect screen, review the summary, and then select Connect.

    Screenshot that shows the filled Add source wizard Review + connect page.

View data stream details

  1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Azure SQL Database CDC as a source. To close the wizard, select Finish at the bottom of the page.

    Screenshot that shows the Review + connect page after successful creation of the source.

  2. In Real-Time hub, select All data streams. To see the new data stream, refresh the All data streams page.

    Screenshot that shows the Real-Time hub All data streams page with the stream you just created.

    For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles: