Edit

Share via

Get events from Google Cloud Pub/Sub into Real-Time hub

  • Article

This article describes how to add Google Cloud Pub/Sub as an event source in Fabric Real-Time hub. Google Pub/Sub is a messaging service that enables you to publish and subscribe to streams of events.

Prerequisites

  • Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
  • A Google Cloud account with the Pub/Sub service enabled. Make sure you select a role with the required permissions.

Get connection information from Google Cloud Pub/Sub

Get the following information from Google Cloud:

  • Project ID
  • Subscription ID
  • Service account key

  1. Get the Project ID from the Google Cloud Console.

    Screenshot that shows Google Cloud Console that shows a project ID.

  2. Get the Subscription ID from the Subscriptions page in Google Cloud Pub/Sub.

    Screenshot that shows Google Cloud Pub/Sub page that shows a subscription ID.

  3. Get the Service account key.

    1. In Google Cloud Console, select IAM & Admin.

      Screenshot that shows Google Cloud Console that shows the admin page.

    2. Select Service Accounts on the left menu, and then select Create Service Account.

      Screenshot that shows Google Cloud Console that shows the Create Service Account page.

    3. After configuring, give your role appropriate permission (Owner) and select Done.

      Screenshot that shows Google Cloud Console that shows the completion of creating the service account.

    4. Select your role, and select Manage keys in Actions.

      Screenshot that shows Google Cloud Console that shows the Manage keys button in Actions.

    5. Select Add Key and then select Create new key.

      Screenshot that shows Google Cloud Console that shows the selection of Create new key.

    6. Download the JSON file and copy all the JSON content as the Service account key.

      Note

      The JSON file can be downloaded only once.

Data sources page

  1. Sign in to Microsoft Fabric.

  2. Select Real-Time on the left navigation bar.

  3. On the Real-Time hub page, select + Data sources under Connect to on the left navigation menu. You can also get to the Data sources page from All data streams or My data streams pages by selecting the + Connect data source button in the top-right corner.

    Screenshot that shows how to launch Connect to data source experience.

Add Google Cloud Pub/Sub as a source

  1. On the Data sources page, select Google Cloud Pub/Sub.

    Screenshot that shows the Select a data source page with Google Cloud Pub/Sub selected.

  2. On the Connect page, select New connection.

    Screenshot that shows the Connect page of the Add source wizard with the **New connection** link highlighted.

  3. In the Connection settings section, specify the Project ID.

    Screenshot that shows the Connection settings section of the New connection page.

  4. In the Connection credentials section, do these steps:

    1. Select an existing connection or keep the default value: Create new connection.

    2. For Subscription name, enter the name of the subscription you noted from Google Cloud Pub/Sub page.

    3. For Service account key, enter the service account key you noted from the Google Cloud Console.

    4. Select Connect.

      Screenshot that shows the Connection credentials section of the New connection page.

  5. On the Connect page, enter source name and topic name for the new source.

    • Source name - Give a name this source.
    • Topic name - It can be any string.

  6. Select Next at the bottom of the page.

  7. On the Review + connect page, review the summary, and select Create source.

View data stream details

  1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Google Cloud Pub/Sub as a source. To close the wizard, select Close or X* in the top-right corner of the page.
  2. In Real-Time hub, select My data streams. To see the new data stream, refresh the page. For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles: