Azure OpenAI quota increase request

Question

Hi,

My company plans to use GPT4 engine to construct an application. I'm responsible for selecting the right services that can meet our needs. However, the default quota and limitations (token per minute) won't cover the expectations. I've read that the quota increase request might be refused and the processing of the requests can be paused.

I wanted to know that how easy is it to scale up the model when deployed on Azure? Is it better that we choose the OpenAi services instead of Azure?

Thank you

Answer 1

Hi @Mohammad

Quota is assigned to your subscription on a per-region, per-model basis in units of Tokens-per-Minute (TPM). When you onboard a subscription to Azure OpenAI, you'll receive default quota for most available models.

Quota Tokens-Per-Minute (TPM) allocation is not related to the max input token limit of a model. Model input token limits are defined in the models table and are not impacted by changes made to TPM.

For increasing Quota limit and request please find documentation.

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/quota?tabs=rest

Please try out these steps with your data and check if it works. Hope this answer helps you with solution! Please comment below if you need any assistance on the same. Happy to help!

I hope the solution is useful to you and then accept the answer.

Regards,

Janarthanan S