baysonfox Greetings!
Thanks for providing additional details and confirmation.
The error message is related to rate limits, which is a common practice in APIs to prevent abuse and ensure fair usage.
Using Azure for Students, I was able to create a resource group and creating an Azure OpenAI resource in the resource group, both the resource group and the Azure OpenAI resource are in East US. However, when I created a model deployment in the created Azure OpenAI resource and tried to test the model in the playground, it would return an error, saying that I've exceeded the quota, telling me to create another conversation after 1 minute.
In your case, the error message indicates that you’ve exceeded the token rate limit of your current AI Services S0 pricing tier.
As you mentioned, you are using Azure for Students subscription. Quota Limit in tokens per minute (TPM) for all models is 1K.
Please see Azure OpenAI Service quotas and limits for more details.
TPM rate limits are based on the maximum number of tokens that are estimated to be processed by a request at the time the request is received. You can check this documentation for more details.
To view your quota allocations across deployments in a given region, select Shared Resources -> Quota in Azure OpenAI studio and click on the link to increase the quota.
Since you are on limited quota, To minimize issues related to rate limits, it's a good idea to use the following techniques:
- Implement retry logic in your application.
- Avoid sharp changes in the workload. Increase the workload gradually.
- Test different load increase patterns.
- Increase the quota assigned to your deployment. Move quota from another deployment, if necessary.
If you are not able to increase the quota on a student subscription, please contact customer service at any time so that we can adjust your limits appropriately.
You must upgrade your Azure for Students Starter subscription to a Pay-As-You-Go subscription to increase your quotas or limits. For more information, see Upgrade your Azure Free Trial subscription to a Pay-As-You-Go subscription
Do let me know if that helps or have any other queries.
If the response helped, please do click Accept Answer
and Yes
for was this answer helpful.