Azure OpenAi GPT 4o returning "rate_limit_exceeded"

Arun Kumar Ganesh 0 Reputation points
2024-11-21T15:30:36.2166667+00:00

Hello,

We have setup a pay as you go account, and we are using Azure openAI services for our internal use case. We have been using GPT-4o for the last 3 months with Assistants API and Azure AI search as well, it was working properly and most of our use case is on document Q&A.

Suddenly from last week, we were facing issues in Assistants API with GPT-40 alone and it is returning "rate_limit_exceeded", while the Azure AI search is still working good on the same use case.

Can someone suggest what could be the possible root cause for this issue? Are there any possibilities for the updates in GPT-4o models, how can we track those updates? We need to make sure this should not happen in future as well Because of this, we had to switch back to GPT-3.5-Turbo to make this work back.

Region - EastUS2

Error Log - "last_error": {

"code": "rate_limit_exceeded",

"message": "Rate limit is exceeded. Try again in 54 seconds."

},

"model": "gpt-4o",

Even after trying again sometime, the results are same and sometimes it prompts us to try again after 24 hours.

Thanks in Advance!

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,302 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,929 questions
0 comments No comments
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.