Azure AI Studio: Cohere-rerank-v3-multilingual - This model is not available for deployment in Azure AI Foundry yet

Vasilis Dr 0

I have created a hub in Sweden Central in Azure AI foundry.

I am trying to deploy the Cohere-rerank-v3-multilingual as proposed in this tutorial but I get the following error:

Model unavailable
This model is not available for deployment in Azure AI Foundry yet

Thank you.

kothapally Snigdha 850 Reputation points Microsoft Vendor

2024-12-19T00:16:19.4666667+00:00
Hi Vasilis Dr,

Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.

It seems you are encountering an issue with deploying the Cohere-rerank-v3-multilingual model in Azure AI Foundry, receiving an error stating that the model is unavailable for deployment.

First, could you confirm if you are using a pay-as-you-go account? Since you've tried deploying in, Sweden Central.

Please note that Azure AI Studio is currently in public preview. This means it is provided without a service-level agreement, and we do not recommend using it for production workloads. Certain features might not be fully supported or may have limited capabilities. For the deployment of C Cohere-rerank-v3-multilingual model, the pay-as-you-go model is only available with AI hubs created in the or Sweden Central regions. Additionally, please ensure that you have the correct roles and resource types set up:

An Azure AI hub resource.https://learn.microsoft.com/en-us/azure/ai-studio/how-to/create-azure-ai-resource?tabs=portal

An Azure AI project in Azure AI Studio.https://learn.microsoft.com/en-us/azure/ai-studio/how-to/create-projects?tabs=ai-studio

Your user account must be assigned the Azure AI Developer role on the resource group to perform these actions.

I hope this helps you! Thank you!
Vasilis Dr 0 Reputation points

2024-12-19T09:28:54.1966667+00:00

Yes all of these are valid to my account (pay-as-you-go & Sweden-Central region). I managed to deploy a Cohere-embed-v3-multilingualsuccessfullly, but the for the Cohere-rerank-v3-multilingual I get the unavailable error. Is there any quota or region specific issue?
kothapally Snigdha 850 Reputation points Microsoft Vendor

2024-12-20T20:08:02.63+00:00

Hi Vasilis Dr,

The Cohere-rerank-v3-multilingual model does not have any quota issues. Regarding specific regions, the development is being carried out in the Sweden Central region. Please clarify whether this development is for a project region or a fine-tuning region.

kindly refer this document. https://learn.microsoft.com/en-us/azure/ai-studio/how-to/deploy-models-cohere-rerank#deploy-cohere-rerank-models-as-serverless-apis

https://learn.microsoft.com/en-us/azure/ai-studio/how-to/deploy-models-serverless-availability#cohere-models

I hope this helps you! Thank you!
kothapally Snigdha 850 Reputation points Microsoft Vendor

2024-12-24T16:31:26.4533333+00:00

Hi Vasilis Dr,

Following up to see if the above response was helpful.
kothapally Snigdha 850 Reputation points Microsoft Vendor

2024-12-26T16:19:05.45+00:00

Hi Vasilis Dr,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Vasilis Dr 0 Reputation points

2025-01-08T11:59:29.22+00:00

Hello and a happy new year!

We are still getting the same error as above, we have double-check the instructions here https://learn.microsoft.com/en-us/azure/ai-studio/how-to/deploy-models-cohere-rerank and everything seems fine according to those.

Do you need any more information from us to resolve this issue.

Thank you.
Vasilis Dr 0 Reputation points

2025-01-08T17:05:24.3866667+00:00

Hello and happy new year! I've checked all the resources but still getting the same error. We managed to deploy the cohere-embed model but not the reranker one.

Here are the details of the project/hub:
Vasilis Dr 0 Reputation points

2025-01-10T11:17:46.6133333+00:00

That worked perfectly, thank you for your assistance @kothapally Snigdha

1 answer

kothapally Snigdha 850 Reputation points Microsoft Vendor

2025-01-09T15:14:05.6066667+00:00

Hi Vasilis Dr

sorry for delay

To deploy theCohere-rerank-v3-multilingual model using the serverless API, follow these steps: can you please refer this link https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-models-cohere-rerank?view=azureml-api-2#create-a-new-deployment

Access your Azure account and navigate to the Azure Machine Learning workspace.

Click on the "Endpoints" section in the workspace.

Choose the "Serverless endpoints" option for model deployment.

Locate the multilingual "Cohere Rank" model within the serverless endpoints

Click on the model and follow the prompts to deploy it as a serverless API.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure AI Studio: Cohere-rerank-v3-multilingual - This model is not available for deployment in Azure AI Foundry yet

1 answer

Your answer