Ensuring Private Connectivity for Cross-Cloud Data Transfers Using STS and Azure Data Factory

Nikunj Patel 0 Reputation points
2024-12-25T21:40:27.41+00:00

Hello,

I am working on a project where Google Cloud and Azure are connected via a private connection (Cloud Interconnect/ExpressRoute). I need to ensure that data transfers between Google Cloud Storage and Azure Storage happen over this private connection, rather than using the public internet.

Specifically, I have two scenarios:

Pulling data from Azure Storage to Google Cloud Storage using Google Cloud's Storage Transfer Service (STS): How can I ensure that STS uses the private connection between Google Cloud and Azure for the transfer, as STS typically uses public APIs and does not inherently support private connectivity out of the box?

Pulling data from Google Cloud Storage to Azure Storage using Azure Data Factory: How can I ensure that Azure Data Factory leverages the private connection (via ExpressRoute or Cloud Interconnect) to transfer data from Google Cloud to Azure, rather than using the public internet?

What configurations or steps should be implemented to ensure both transfers occur securely over the private connection?

I appreciate any insights or guidance on how to set up private connectivity for both of these data transfer scenarios.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,048 questions
Azure ExpressRoute
Azure ExpressRoute
An Azure service that provides private connections between Azure datacenters and infrastructure, either on premises or in a colocation environment.
399 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.