How to fix web activity error "Error calling the endpoint" for Azure API management service from Azure data factory

Chodisetti, Veda 0

I have an azure data factory in VNet and API management service with virtual network type "Internal". I am trying to invoke one of the Api endpoints from data factory using web activity "POST" method but getting the below mentioned error from ADF. The same endpoint is working from postman but not from ADF. In the web activity, I'm using the same type of authentication and headers which were used in postman. Also, the runtime we are using in the web activity has interactive authoring enabled.

Error message from ADF web activity: "Error calling the endpoint 'https://apim-test-dev.azure-api.net'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] The remote name could not be resolved: 'apim-test-dev.azure-api.net''. Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout."

Any pointers to help this issue would be greatly appreciated.

Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
AnnuKumari-MSFT 34,011 Reputation points Microsoft Employee

2024-04-23T14:53:43.0466667+00:00

Hi Chodisetti, Veda ,

Welcome to Microsoft Q&A platform and thanks for posting your query here.

I understand that you are facing an issue while invoking an API endpoint from Azure Data Factory using a web activity Post method.

Issue could be due to network connectivity between your ADF and the API Endpoint. Since the ADF is in VNet, kindly check if Private End Point is enabled and working as expected.

When you create an Azure integration runtime within a Data Factory managed virtual network, the integration runtime is provisioned with the managed virtual network. It uses private endpoints to securely connect to supported data stores.

You can create a new managed private endpoint in Manage Hub.

The troubleshooting guide suggests the mitigation to overcome the issue, kindly validate the same.

Kindly go through these relevant documents for more details:

Managed private endpoints in Azure Data Factory managed virtual network

Troubleshooting guide

https://learn.microsoft.com/en-us/answers/questions/1427560/web-activity-is-throwing-an-error-in-adf-pipeline

Hope it helps. Thankyou
Chodisetti, Veda 0 Reputation points

2024-04-23T15:17:42.4433333+00:00

Hi @AnnuKumari-MSFT

Thanks for reaching out. I have already tried the recommendation in the Troubleshooting guide to validate the request. I can invoke the APIM directly from postman but not from ADF.

Also, I have checked the private endpoint is enabled for ADF, it is working as expected.

There is no option to create managed private endpoint for APIM.
AnnuKumari-MSFT 34,011 Reputation points Microsoft Employee

2024-05-14T11:04:56.39+00:00

Chodisetti, Veda , It seems there might be network security groups (NSGs), firewalls, or route tables blocking traffic between Azure Data Factory and API Management. Ensure that the necessary network configurations allow communication between the two services.

However, For a deeper investigation and immediate assistance on this issue , I would recommend you to create support ticket for better assistance where dedicated engineers might help you. Thankyou
Puffer, Robert 0 Reputation points

2024-09-03T15:45:34.32+00:00

Curious, Did MSFT provide a solution on this one? We are trying the same thing, get the same error and I just verified using postman and passing in the keys and token and the call is processed as expected and returns a proper result. If I create the connection in ADF, it creates a cloud connection but it appears to connect and save. The error is on the run of the web component in ADF. I then tried setting up a VNET Web2 connection instead of using ADF and I got this with the same info -->

Unable to create connection for the following reason: DM_GWPipeline_Client_ServicePrincipalOAuthTokenGenerateFailedError



Details: VNET-abc123: The resource principal named abc123 was not found in the tenant host.com. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You might have sent your authentication request to the wrong tenant.

Again, postman works as expected.. thanks

1 answer

Tejaswi Datla 0 Reputation points

2025-02-07T00:19:13.8+00:00

I got the same error.
Error calling the endpoint 'https://login.microsoftonline.com'. Response status code: 'NA - Unknown'. More details: Exception message: 'NA - Unknown [ClientSideException] Misused header name. Make sure request headers are used with HttpRequestMessage, response headers with HttpResponseMessage, and content headers with HttpContent objects.'.

Request didn't reach the server from the client. This could happen because of an underlying issue such as network connectivity, a DNS failure, a server certificate validation or a timeout.

But when I POST using postman, I get a response with status 200
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to fix web activity error "Error calling the endpoint" for Azure API management service from Azure data factory

1 answer

Your answer