I would like to increase my openAI azure deployment token rate limit from 450k to 7.5M

Question

Hi!

We are going to launch our MVP to 500 test users,
which runs with openAI gpt-4o azure deployment.

It has a max 450k token rate limit / minute, which will be not enough for us on
more busy hours, as we going to have 500 users for testing purposes,
and one single call for us because of the usecase is around 15k token.

So it is roughly 30 call/minute, we would like to increase it to 500 call/minute which would be 7.5M token per minute limit.

At least for a month between january 17 and february 17, as that will be our UAT.

Thank you in advance!

Answer 1

Hi,

You can check the region where you have deploy your Azure OpenAI on this link because depending on the region, this is not possible : https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits

You need to open a support ticket on the Azure portal for a token increase because you have reached the limit.

Sincerely,