DATA FACTORY COPY DATA TO REST API - Failure happened on 'Sink' side. ErrorCode=UserErrorPropertyInvalidOrMissing,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The property 'additionalHeaders' is invalid or missing.,Sour

Kafka Hava 20 Reputation points
2024-12-30T07:02:15.7366667+00:00

DATA FACTORY COPY DATA TO REST API returns Failure happened on 'Sink' side. ErrorCode=UserErrorPropertyInvalidOrMissing,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The property 'additionalHeaders' is invalid or missing.,Sour

additionalHeaders exist and created as expected

What could be the reason?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,134 questions
{count} votes

Accepted answer
  1. Sina Salam 15,571 Reputation points
    2024-12-30T10:35:56.5933333+00:00

    Hello Kafka Hava,

    Welcome to the Microsoft Q&A and thank you for posting your questions here.

    I understand that you are having error with ErrorCode=UserErrorPropertyInvalidOrMissing, ...... The property 'additionalHeaders' is invalid or missing.,Sour in Azure Data Factory when copying data to a REST API.

    The error shows that a mismatch between what ADF expects for additionalHeaders and the configured property. Even though you've created additionalHeaders as expected, there could be several reasons for this error: Incorrect Header Format, Case Sensitivity, Required Headers Missing, Header Values, API Endpoint Configuration, and Permissions.

    To resolve this:

    1. Validate additionalHeaders Syntax by ensuring that the JSON syntax follows the schema provided - https://learn.microsoft.com/en-us/azure/data-factory/connector-rest#additionalheaders
    2. Use Debugging Tools available in ADF Pipeline Debugging.
    3. Review the API's documentation to ensure you are sending all required headers in the correct format. - https://learn.microsoft.com/en-us/rest/api
    4. Verify ADF REST Dataset Configuration that the dataset aligns with the API's expected schema and requirements.- https://learn.microsoft.com/en-us/azure/data-factory/connector-rest#dataset-properties
    5. Check for ADF Limitations or Known Issues - https://learn.microsoft.com/en-us/azure/data-factory/connector-rest#limitations
    6. Use a minimal configuration for headers to isolate the problem. This is best tested with tools like Postman or directly in the ADF pipeline using simple headers such as:
              {
                "Authorization": "Bearer <token>"
              }
      

    Should there be issue that all the above could not solve your issue, check the below link for more advance troubleshooting and debugging:

    1. Debugging HTTP(S) Traffic with Fiddler - https://www.telerik.com/fiddler
    2. Using Web Activity in Azure Data Factory. - https://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

    I hope this is helpful! Do not hesitate to let me know if you have any other questions.


    Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.


1 additional answer

Sort by: Most helpful
  1. Kafka Hava 20 Reputation points
    2025-01-02T14:38:52.45+00:00

    Verified all

    Web activity with same additionalHeaders works properly

    COPY DATA not

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.