Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,539 questions
rate Limited exceeded error
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 18%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMD%3C/text%3E%3C/svg%3E)
Manaswita Datta
0
Reputation points Microsoft Employee
I am getting the below error while using gpt-4o model
"Error occurred with msg: HTTP 429 (429) Rate limit is exceeded. Try again in 1 seconds. and stacktrace : at Azure.AI.OpenAI.ClientPipelineExtensions.ProcessMessage(ClientPipeline pipeline, PipelineMessage message, RequestOptions options) at Azure.AI.OpenAI.Chat.AzureChatClient.CompleteChat(BinaryContent content, RequestOptions options) at OpenAI.Chat.ChatClient.CompleteChat(IEnumerable
1 messages, ChatCompletionOptions options, CancellationToken cancellationToken) at Azure.AI.OpenAI.Chat.AzureChatClient.CompleteChat(IEnumerable1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)"
Below is the configuration of the model:
Question: what configuration to update to not hit the rate limiter error?
{count} votes
-
Manaswita Datta 0 Reputation points Microsoft Employee
2025-01-18T14:10:44.34+00:00 Just to add: am using exponential backoff with delay of 1000 ms for the retry mechanism.
Sign in to comment
Sign in to answer