Add SQL Server on VM DB (CDC) as source in Real-Time hub
This article describes how to add SQL Server on VM DB (CDC) as an event source in Fabric Real-Time hub.
The SQL Server on VM DB (CDC) source connector for Fabric eventstreams allows you to capture a snapshot of the current data in a SQL Server database on VM. The connector then monitors and records any future row-level changes to the data. Once these changes are captured in the eventstream, you can process this data in real-time and send it to various destinations for further processing or analysis.
Prerequisites
- Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
- A running SQL Server on VM database.
- Your SQL Server on VM database must be configured to allow public access.
- Enable CDC in your SQL Server on VM database by running the stored procedure
sys.sp_cdc_enable_db
. For details, see Enable and disable change data capture.
Enable CDC in your SQL Server on VM database
Enable CDC for the database.
EXEC sys.sp_cdc_enable_db;
Enable CDC for a table using a gating role option. In this example,
MyTable
is the name of the SQL table.EXEC sys.sp_cdc_enable_table @source_schema = N'dbo', @source_name = N'MyTable', @role_name = NULL GO
After the query executes successfully, you enabled CDC in your SQL Server on VM database.
Get events from SQL Server on VM DB (CDC)
You can get events from an SQL Server on VM DB (CDC) into Real-Time hub using the Data sources page.
Data sources page
Sign in to Microsoft Fabric.
Select Real-Time on the left navigation bar.
On the Real-Time hub page, select + Data sources under Connect to on the left navigation menu. You can also get to the Data sources page from All data streams or My data streams pages by selecting the + Connect data source button in the top-right corner.
On the Data sources page, select Database CDC category at the top, and then select Connect on the Azure SQL MI DB (CDC) tile.
Use instructions from the Add SQL Server on VM DB CDC as a source section.
Add SQL Server on VM DB CDC as a source
On the Connect page, select New connection.
In the Connection settings section, enter the following values for your SQL Server on VM:
Server: Enter the publicly accessible IP address or domain name of your VM, and then add a colon and the port. For example, if your IP address is
xx.xxx.xxx.xxx
and the port is 1433, then you should enterxx.xxx.xxx.xxx:1433
in the Server field. If the port isn't specified, the default port value1433
is used.Database: Enter the name of the database that you want to connect to on your SQL Server on VM.
Scroll down, and in the Connection credentials section, follow these steps.
For Connection name, enter a name for the connection.
For Authentication kind, select Basic.
Note
Currently, Fabric event streams supports only Basic authentication.
Enter Username and Password for the SQL Server on VM.
Note
Don't select the option: Use encrypted connection.
Select Connect at the bottom of the page.
Now, on the Connect page, select All tables, or enter the table names separated by commas, such as:
dbo.table1, dbo.table2
.Select Next.
On the Review + create screen, review the summary, and then select Connect.
View data stream details
- On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected SQL Server on VM DB (CDC) as a source. To close the wizard, select Close or X* in the top-right corner of the page.
- In Real-Time hub, select All data streams. To see the new data stream, refresh the All data streams page. For detailed steps, see View details of data streams in Fabric Real-Time hub.
Related content
To learn about consuming data streams, see the following articles: