Error 429 in Foundry AI Playground as Soon as Data is Added

Wayne Hans 0

Within Azure Foundry AI playground, I am able to use the gpt-4o-mini(2024-07-18) model and chat with simple commands. As soon as I add data (one word doc or PDF for example) it throws the error 429 about hitting the rate limit (Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 60 seconds.'}}). This can't be a rate limit since it's the first query I've sent. I've tried adding data sources with different settings all with the same result. What am I doing wrong or is this a bug?

Pavankumar Purilla 3,410 Reputation points Microsoft Vendor

2025-02-19T22:31:35.1666667+00:00

Hi Wayne Hans,
Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.
I apologize for the inconvenience you're experiencing. This issue is not a bug. Could you please let me know which region you are working in? This information will help us better understand and address the problem.
SriLakshmi C 2,825 Reputation points Microsoft Vendor

2025-02-20T09:41:43.3766667+00:00

Hi Wayne Hans,

The error message is related to rate limits, which is a common practice in APIs to prevent abuse and ensure fair usage.

I attempted to reproduce the issue in my environment, but everything worked fine for me.

In your case, the error message indicates that you’ve exceeded the token rate limit of your current AI Services S0 pricing tier.

Azure OpenAI’s quota feature enables assignment of rate limits to your deployments, up-to a global limit called your “quota.” Quota is assigned to your subscription on a per-region, per-model basis in units of Tokens-per-Minute (TPM).

You can check this documentation for more details.

To give more context, Tokens-Per-Minute (TPM) and Requests-Per-Minute (RPM) rate limits for the deployment.

TPM rate limits are based on the maximum number of tokens that are estimated to be processed by a request at the time the request is received.

RPM rate limits are based on the number of requests received over time. The rate limit expects that requests be evenly distributed over a one-minute period. If this average flow isn't maintained, then requests may receive a 429 response even though the limit isn't met when measured over the course of a minute.

Please see Manage Azure OpenAI Service quota for more details.

To view your quota allocations across deployments in a given region, select Shared Resources> Quota in Azure OpenAI studio and click on the link to increase the quota.

I hope this helps. Do let us know if you have further queries.

Thank you!

2 answers

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Wayne Hans 0 Reputation points

2025-02-20T12:13:27.52+00:00

Good Morning and thanks for the responses. I came in this morning and the error was no longer appearing without making any changes. It seems as if there was a large delay before it could be used despite showing as ready. It's not ideal to wait hours for the service to function, but at least it's working now. Thank you.
Please sign in to rate this answer.
Pavankumar Purilla 3,410 Reputation points Microsoft Vendor

2025-02-20T16:19:25.3533333+00:00

Hi Wayne Hans
I am glad to hear that your issue has been resolved. Thank you
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Error 429 in Foundry AI Playground as Soon as Data is Added

2 answers

Your answer