Does ADF Mapping Flows support Cosmos DB Serverless?

javier 941 Reputation points
2020-12-10T23:16:57.943+00:00

Hi I'm trying to insert records in bulk using ADF Mapping Flows. Source is in csv format. However I get the following error when debugging:

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': java.lang.IllegalStateException: com.microsoft.azure.documentdb.DocumentClientException: Reading or replacing offers is not supported for serverless accounts.\r\nActivityId: 6bfbf055-49fb-4547-94b9-0b09f4b15ecc, Microsoft.Azure.Documents.Common/2.11.0, StatusCode: BadRequest","Details":"at Sink 'sink1': java.lang.IllegalStateException: com.microsoft.azure.documentdb.DocumentClientException: Reading or replacing offers is not supported for serverless accounts.\r\nActivityId: 6bfbf055-49fb-4547-94b9-0b09f4b15ecc, Microsoft.Azure.Documents.Common/2.11.0, StatusCode: BadRequest"}

My understanding is that ADF is trying to change an offer and that conflicts with the fact that my db is in serverless mode. Is there any setting that I am missing to adjust here?

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,773 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,291 questions
0 comments No comments
{count} vote

Accepted answer
  1. KeshavKiran-MSFT 391 Reputation points Microsoft Employee
    2020-12-11T10:44:14.693+00:00

    Hi @javier ,

    Welcome to Microsoft Q&A platform and thank you for your query.

    With regards to the specific error that you have highlighted, I reproduced and observed the same. Seems CosmosDB Serverless is not currently supported as Sink for the Data flow in the Azure data factory. I reached out to Product team and they confirmed the same, there is a plan in backlog to implement this in future but there is no planned timeline for the release yet. We will also work with them to add the same to this document.

    Meanwhile as a workaround ,you can try using copy activity in your pipeline and specifying the Cosmos DB Serverless as a sink in the data factory.

    Thank you for your continued patience.

    ----

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

3 additional answers

Sort by: Most helpful
  1. Mohammad Saleem Sheik 16 Reputation points
    2022-09-07T13:20:05.58+00:00

    Cosmos DB serverless was released a long time ago. Do you have any plans to support it in DF or Azure Analytics Mapping Dataflow?

    3 people found this answer helpful.
    0 comments No comments

  2. Roman Marusyk 26 Reputation points
    2022-05-31T21:48:10.483+00:00

    Cosmos DB serverless was released a long time ago. Do you have any plans to support it in DF?

    2 people found this answer helpful.
    0 comments No comments

  3. Zhangyi Yu 6 Reputation points Microsoft Employee
    2020-12-11T11:39:09.377+00:00

    Today the cosmos serverless is at preview status https://devblogs.microsoft.com/cosmosdb/serverless-preview/, when it is stable and GA, we will support this in ADF dataflow. Before that, you can try using copy activity and specifying the Cosmos DB Serverless as a sink in the data factory

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.