Using Managed Virtual Network Integration Runtime in Data Flows

Paila, S (Sreenu) 0

I have created a Managed Virtual Network Integrated Runtime (MVNet IR) and successfully connected it to Azure SQL. I can access the database through datasets using this runtime without any issues.

However, when creating Data Flows using the same datasets (which successfully connect via MVNet IR), the data flows do not use the Managed Virtual Network Integrated Runtime. Instead, they default to AutoResolveIntegrationRuntime.

I couldn't find any official documentation on using Managed Virtual Network Integrated Runtime in Data Flows.

Is there a way to configure Data Flows to use MVNet IR instead of AutoResolveIntegrationRuntime?

Amira Bedhiafi 29,711 Reputation points

2025-03-07T12:43:51.71+00:00

If your primary goal is to move data securely between Azure SQL and other data stores within the Managed Virtual Network, you can use the Copy Activity with MVNet IR.

After transferring the data using the Copy Activity, you can then use Data Flows for further transformations.

If you need more control over the network and integration runtime, you can consider using a Self-hosted Integration Runtime (SHIR) within your virtual network. SHIR can be installed on a VM within your virtual network and can be used to connect to on-premises data sources or other resources within the virtual network.

Note that SHIR requires more maintenance and management compared to MVNet IR.

If your data sources and sinks have public endpoints, you can use Data Flows with the default AutoResolveIntegrationRuntime. Ensure that you have proper security measures in place, such as firewalls, IP whitelisting, and encryption, to secure the data transfer.

For Azure SQL and other Azure services, you can configure private endpoints within your virtual network. This allows you to securely access these services without exposing them to the public internet. While Data Flows will still use AutoResolveIntegrationRuntime, the private endpoints ensure that the data transfer happens within the virtual network.

1 answer

Deepanshu katara 14,490 Reputation points MVP

2025-03-07T12:36:25.86+00:00

Hello Paila, Welcome to MS Q&A

Azure Data Flows currently do not support Managed Virtual Network Integration Runtime (MVNet IR) directly. Instead, they default to AutoResolveIntegrationRuntime, which does not operate within the managed VNet.

Since MVNet IR is designed for secure data movement rather than data transformation, you may need to work around this by Using a Self-Hosted Integration Runtime (SHIR)

Please let us know if you have any ques

Kindly accept answer if it helps

Thanks
Deepanshu
Please sign in to rate this answer.
Paila, S (Sreenu) 0 Reputation points

2025-03-07T14:20:55.74+00:00

I fixed the above issues. Thanks for your input.

What is the best optin to move the data from one table to another using ADF?

Smaran Thoomu 21,160 Reputation points Microsoft External Staff

2025-03-07T14:36:44.46+00:00

Hi @Paila, S (Sreenu)
Glad to hear that you resolved the previous issue!
To move data from one table to another in Azure Data Factory (ADF), you have a few options depending on your requirements:

Copy Activity – Best for simple data movement with minimal transformation. It efficiently transfers data between source and destination tables.

Data Flow – If you need transformations like filtering, aggregations, or lookups before moving data, Mapping Data Flows provide a no-code solution.

Stored Procedure Activity – If your target is Azure SQL Database or Synapse, you can use a stored procedure to handle data movement more efficiently.

Azure Data Lake + Copy Activity – If dealing with large datasets, staging the data in Azure Data Lake Storage (ADLS) before loading it into the target table can optimize performance.

Let me know more about your specific use case, and I would be happy to suggest the best approach!
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Using Managed Virtual Network Integration Runtime in Data Flows

1 answer

Your answer