Edit

Share via

Add Google Cloud Pub/Sub source to an eventstream

  • Article

This article shows you how to add a Google Cloud Pub/Sub source to an eventstream.

Google Pub/Sub is a messaging service that enables you to publish and subscribe to streams of events. You can add Google Pub/Sub as a source to your eventstream to capture, transform, and route real-time events to various destinations in Fabric.

Note

This source is not supported in the following regions of your workspace capacity: West US3, Switzerland West.

Prerequisites

  • Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
  • A Google Cloud account with the Pub/Sub service enabled and a role with the required permissions.
  • Your Google Cloud Pub/Sub source must be publicly accessible and not be behind a firewall or secured in a virtual network.
  • If you don't have an eventstream, create an eventstream.

Add Google Cloud Pub/Sub as a source

If you haven't added any source to your eventstream yet, select Use external source tile.

Screenshot that shows the selection of Use external source tile.

If you're adding the source to an already published eventstream, switch to Edit mode, select Add source on the ribbon, and then select External sources.

Screenshot that shows the selection of Add source to External sources menu.  

On the Select a data source page, search for and select Connect on the Azure Event Hubs tile.

Screenshot that shows the selection of Google Cloud Pub/Sub as the source type in the Select a data source wizard.

Configure and connect to Google Cloud Pub/Sub

Important

You can consume the Google Cloud Pub/Sub events in only one eventstream. Once you fetch the events into an eventstream, they can't be consumed by other eventstreams.

  1. On the Connect screen, under Connection, select New connection.

    Screenshot that shows the Connect page for Google Cloud Pub/Sub.

  2. On the Connection settings screen, fill out the required information.

    A screenshot of the Connection settings for the Google Cloud Pub/Sub source.

  3. For Project ID, enter the Project ID from your Google Cloud Console.

    A screenshot of the Project ID in the Google Cloud Console.

  4. For Subscription name, open your Google Pub/Sub and select Subscriptions. You can find the Subscription ID in the list.

    A screenshot of a computer Description automatically generated.

  5. Service account key is a JSON file that contains the credentials of your service account. Follow the next steps to generate the file in Google Cloud.

    1. Select IAM & Admin in your Google Cloud Console.

      A screenshot of selecting IAM & Admin in Google Cloud Console.

    2. On the IAM & Admin page, under Service Accounts, select CREATE SERVICE ACCOUNT.

      A screenshot of selecting Create service account.

    3. After configuring, give your role appropriate Owner permission, and then select Done.

      A screenshot of giving your role Owner permissions and then selecting Done.

    4. On the Service accounts page, select your role and then select Manage keys under Actions.

      A screenshot of selecting Manage keys under Actions.

    5. Under ADD KEY, select Create new key.

      A screenshot of selecting Create new key.

    6. Download the JSON file, copy all the JSON content, and enter it as Service account key on the Fabric Connection settings screen.

      Important

      This JSON file can be downloaded only once.

  6. Select Connect on the Connection settings screen.

  7. Review the summary, and then select Add.

You can see the Google Cloud Pub/Sub source added to your eventstream in Edit mode.

A screenshot of the added Google Cloud Pub/Sub source in Edit mode with the Publish button highlighted.

Select Publish to publish the changes and begin streaming data from Google Cloud Pub/Sub to the eventstream.

A screenshot of the published eventstream with Google Cloud Pub/Sub source in Live View.

Related content

Other connectors: