Edit

Share via

Add Amazon Kinesis Data Streams as source in Real-Time hub

  • Article

This article describes how to add Amazon Kinesis Data Streams as an event source in Fabric Real-Time hub.

Prerequisites

  • Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
  • An Amazon Web Services (AWS) account with the Kinesis Data Streams service enabled.

Data sources page

  1. Sign in to Microsoft Fabric.

  2. Select Real-Time on the left navigation bar.

  3. On the Real-Time hub page, select + Data sources under Connect to on the left navigation menu. You can also get to the Data sources page from All data streams or My data streams pages by selecting the + Connect data source button in the top-right corner.

    Screenshot that shows how to launch Connect to data source experience.

Add Amazon Kinesis Data Streams as a source

  1. On the Select a data source screen, select Kinesis Data Streams.

    A screenshot of selecting Kinesis Data Streams.

  2. On the Connect screen, to create a connection, select New connection.

    Screenshot that shows the Connect page with the New connection highlighted.

  3. In the Connection settings section, for Data Stream name, enter the data stream name from Amazon Kinesis.

    A screenshot of the Amazon Kinesis data stream screen.

  4. In the Connection credentials section, do these steps.

    1. For Connection name, enter a name for this cloud connection.

    2. For Authentication kind, confirm that Kinesis key is selected.

    3. For API Key and API Secret, enter the credentials you use to access your Kinesis Data Stream. Go to the Amazon IAM console and select Security credentials. Copy an Access Key ID from the Access keys screen and paste it into API Key and API Secret.

      A screenshot of how to access the AWS Kinesis security credentials.

    4. Select Connect.

      A screenshot of the Connect screen.

  5. Now, on the Connect page, for Source name, enter a source name for this new eventstream source.

  6. Scroll down, and under Configure Amazon Kinesis data source, enter a Region for the data source. You can find the Amazon region code such as us-west-2 from the Kinesis Data stream summary.

    A screenshot of the Region field for Configure Amazon Kinesis data source.

  7. In the Stream details section of the right pane, do these steps:

    1. Select the workspace where you want to save the connection.
    2. Enter a name for the eventstream to be created for you.
    3. Name of the stream for Real-Time hub is automatically generated for you.

  8. Select Next.

  9. On the Review + create screen, review the summary, and then select Connect.

View data stream details

  1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Confluent Cloud Kafka source. To close the wizard, select Close at the bottom of the page.
  2. In Real-Time hub, select My data streams. To see the new data stream, refresh the page. For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles: