Getting token rate limit exceeded error

Khan, Mohammad 0

Hi,

In my application, I am trying to connect to gpt-4 with api_version = 2024-08-01-preview and using a trial account. While running the application, I am geeting the error:

"Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-08-01-preview have exceeded token rate limit of your current OpenAI S0 pricing tier. Please retry after 86400 seconds. Please go here: https://aka.ms/oai/quotaincrease if you would like to further increase the default rate limit"

In my account, I still have sufficient credit available and my application is pretty simple - I am just asking gpt-4 a simple question. The above error does not make sense to me. Not sure why I am getting this error.

Any suggestions\ help appreciated.

Thanks,

Mohammad

romungi-MSFT 47,241 Reputation points Microsoft Employee

2024-12-02T08:43:12.6533333+00:00

@Khan, Mohammad I understand that you are using your $200 free credit and deployed a model. If you are not converted to a pay as you go account yet some checks might be in place to minimize misuse of the $200 credit. I would recommend going ahead and submit a quota increase request from the link mentioned and once you are approved you should be able to use them.
Khan, Mohammad 0 Reputation points

2024-12-02T16:35:52.52+00:00

@romungi-MSFT Thanks for your response. I submitted a quota increase request and I received an email from Microsoft Azure OpenAI msazureopenai@microsoft.com with the following info:

As of November 20, 2024, your resource has been updated to 200 quota (200000 tokens per minute and 600 requests per minute) for the gpt-4-turbo model in the North Central US Azure region.

Any suggestions here?
romungi-MSFT 47,241 Reputation points Microsoft Employee

2024-12-03T04:32:09.16+00:00

@Khan, Mohammad Is the error still seen an error after receiving this confirmation?

Share via

Getting token rate limit exceeded error

Your answer