Hi Community!
I’m running into a challenging issue with my Azure Data Factory setup. Here’s what my current infrastructure looks like:
- Azure Data Factory (ADF)
- CosmosDB
- Key Vault
- Storage Account
- Private Networks
Everything was set up months ago and worked smoothly until this week—now my ADF pipelines are failing.
Here's an overview of the pipeline:
- Step 1: Data is extracted from one storage account, processed, and saved in another storage account.
- Step 2: The stored data is then retrieved and saved into CosmosDB.
Before that,:
I have a runtime running
And a Linked service with connection to the CosmosDB
After testing the linked service I can see that I have access and I can see the data.
However, when I run the pipeline I see this information
And after 10 min I have the following error
And I don't see what could happen.
Extra information:
The ADF has the following roles and assignments
And the networking using private endpoints:
In short, if I test them independently, everything works, but running the pipeline I have no access...
Has anyone encountered a similar problem or has any advice? Any help would be much appreciated!
Thanks a lot for your help.!