Vector Search in Azure Cosmos DB for NoSQL

Guillaume Dupont 0

Hello,

I would like to create a container for building a RAG solution with Azure Cosmos NoSQL: https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/vector-search

This works if i create the BD via python, but i cannot find any reference in the API https://learn.microsoft.com/en-us/azure/templates/microsoft.documentdb/2024-05-15-preview/databaseaccounts/sqldatabases/containers?pivots=deployment-language-terraform

on how to create it via arm/azapi, to industrialize it via Terraform. It is currently possible ?

Thanks !

Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-10-30T12:17:09.53+00:00

Hi @Guillaume Dupont,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

how to create it via arm/azapi, to industrialize it via Terraform. It is currently possible ?

Yes, it is possible to create an Azure Cosmos DB via ARM (Azure Resource Manager) or azapi and industrialize it using Terraform.

I would request you to refer the below mentioned links for more information.

https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/manage-with-terraform#create-manual.

https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/cosmosdb_sql_container

https://www.youtube.com/watch?v=jgg5s-DPK6s

I hope this information helps. Please do let us know if you have any further queries.

Guillaume Dupont 0

Hi @Mahesh Kurva Thank you for your response.
Are you sure the terraform module can handle the vector embedding parameter from https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/vector-search which is still in preview ? :

{
    "vectorEmbeddings": [
        {
            "path":"/vector1",
            "dataType":"float32",
            "distanceFunction":"cosine",
            "dimensions":1536
        },
        {
            "path":"/vector2",
            "dataType":"int8",
            "distanceFunction":"dotproduct",
            "dimensions":100
        }
    ]
}

Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-10-30T19:07:18.87+00:00
Hi @Guillaume Dupont,

Thank you for getting back to me.

As of now, the vector search feature of Azure Cosmos DB for NoSQL is in preview. This means that while you can technically implement features related to it, comprehensive support in Terraform modules may not yet be fully fleshed out, which includes parameters related to vector embeddings.

If you have successfully created the container using Python, that might be the most reliable way to ensure you have all necessary configurations until the Terraform support is improved.

https://learn.microsoft.com/en-us/python/api/azure-cosmos/azure.cosmos.cosmosclient?view=azure-python#azure-cosmos-cosmosclient-create-database

I hope this information helps. Please do let us know if you have any further queries.
Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-11-01T16:47:24.7933333+00:00

Hi @Guillaume Dupont,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Guillaume Dupont 0 Reputation points

2024-11-04T08:32:14.1566667+00:00

Hello @Mahesh Kurva

I have submitted a support ticket and i'm waiting for a response from the PG team to confirm the feature is not supported. I let you know how it ends.

Thank you very much
Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-11-04T18:00:34.5033333+00:00

Hi @Guillaume Dupont,

Could you kindly provide your SR# for our internal tracking? Once you receive any updates, it would be greatly appreciated if you could share them with the community. This will be helpful for others who might encounter a similar issue.
Guillaume Dupont 0 Reputation points

2024-11-13T10:06:44.4833333+00:00

Hello here is the answer from the PG team:

"Thank you for your patience.

I’ve checked with the PG engineer, and they’ve confirmed that creating a collection with vector embedding via ARM, AzAPI, or Terraform is not yet supported, but it will be available soon.

The exact ETA is still to be determined. In the meantime, you can define collections with vector embedding using the data SDKs."
Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-11-13T19:18:15.66+00:00

Hi @Guillaume Dupont,

Glad to know your issue has been resolved. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

1 answer

Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-11-13T19:17:56.91+00:00

Hi @Guillaume Dupont,

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer.

Issue:

I would like to create a container for building a RAG solution with Azure Cosmos NoSQL: https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/vector-search

This works if i create the BD via python, but i cannot find any reference in the API https://learn.microsoft.com/en-us/azure/templates/microsoft.documentdb/2024-05-15-preview/databaseaccounts/sqldatabases/containers?pivots=deployment-language-terraform

on how to create it via arm/azapi, to industrialize it via Terraform. It is currently possible ?

Solution:

I’ve checked with the PG engineer, and they’ve confirmed that creating a collection with vector embedding via ARM, AzAPI, or Terraform is not yet supported, but it will be available soon.

The exact ETA is still to be determined. In the meantime, you can define collections with vector embedding using the data SDKs."

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

Hope this helps. Do let us know if you have any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Mahesh Kurva 975 Reputation points Microsoft Vendor

2024-11-14T19:17:46.81+00:00

Hi @Guillaume Dupont,

Glad to know your issue has been resolved. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Vector Search in Azure Cosmos DB for NoSQL

1 answer

Your answer