Issue with Token Rate Limit when Uploading Files to OpenAI Playground

Jason 0

I am encountering an issue when using the Azure OpenAI API. When I send a prompt without attaching any file, the model responds as expected with information. However, when I attach a file to my prompt, I receive the following error message:

"Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-10-01-preview have exceeded token rate limit of your current AIServices S0 pricing tier. Please retry after 86400 seconds. Please contact Azure support service if you would like to further increase the default rate limit."

This issue occurs while using the free trial account. Could you please assist me with the following:

Why am I receiving this error when attaching a file, and how is it related to the token rate limit?
How can I resolve this issue without upgrading my account or increasing my current rate limit while still using the free trial account?
Are there any optimizations I can apply to prevent exceeding the token rate limit when uploading files, while still maintaining the ability to query with files?

I would appreciate any guidance or suggestions on how to overcome this limitation

kothapally Snigdha 1,185 Reputation points Microsoft Vendor

2025-01-24T17:39:01.8366667+00:00
Hi Jason

Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.

I understand that you're facing an issue Token rate limit uploading files When you attach a file to your prompt while using the Azure OpenAI API, the processing of that file counts towards your token rate limit. Each image processed counts towards your tokens per minute (TPM) limit, which is likely why you are encountering the error message indicating that you have exceeded the token rate limit for your current pricing tier.

The error occurs because the file you are attaching increases the token count being processed, which can quickly reach the limit set for your free trial account. The token rate limit is based on the maximum number of tokens that can be processed per minute, and attaching files can significantly increase that count.

To resolve this issue without upgrading your account or increasing your rate limit, you can try to minimize the size of the files you are uploading or reduce the frequency of your requests. Additionally, consider breaking down your queries into smaller parts or using simpler prompts that require less processing.

For optimizations, you can implement the following strategies:

Reduce the size of the files you upload to ensure they consume fewer tokens.

Space out your requests to avoid hitting the rate limit.

Use smaller or fewer files in your queries to keep the token count lower.

Please refer the documents services Quotas& limits Manage Azure open AI service Quota

I hope this helps you. Thank you.
kothapally Snigdha 1,185 Reputation points Microsoft Vendor

2025-01-26T15:23:40.29+00:00

Hi Jason

Following up to see if the above response was helpful.
kothapally Snigdha 1,185 Reputation points Microsoft Vendor

2025-01-27T08:12:34.0533333+00:00

Hi Jason

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Jason 0 Reputation points

2025-01-28T00:40:56.54+00:00
Hi Mr kothapally Snigdha,

Thanks for your reply, Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters,When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground,

I click the 'Add Data' button

Choose the 'Data Source' option then select 'Upload File Preview,'

Pick my Blob Storage.

Select the 'Search Resource' with a basic subscription

create an index name

upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 0 Reputation points

2025-01-28T00:44:00.7766667+00:00
Hi Mr kothapally Snigdha,Thanks for your reply. Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters, When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground, I click the 'Add Data' button

Choose the 'Data Source' option, then select 'Upload File Preview,'

Pick my Blob Storage

Select the 'Search Resource' with a basic subscription

Create an index name

Upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 0 Reputation points

2025-01-30T08:17:31.1533333+00:00

here is the screenshot without uploading data it works,

after i uploading data, it doesnt work
Jason 0 Reputation points

2025-01-30T08:27:34.55+00:00

hi, is there any solution ?
kothapally Snigdha 1,185 Reputation points Microsoft Vendor

2025-01-30T10:33:27.94+00:00

Hi Jason

sorry for delay

I was able to reproduce the scenario in my environment, and it is working as expected. Could you please increase the token rate limit and retry uploading the files?

I hope these helps you. Thank you.
Jason 0 Reputation points

2025-01-31T01:00:41.09+00:00

Hi Mr kothapally Snigdha,Thanks for your replies, how to increase the token rate limit ?

I cannot adjust the rate limit, can you show me how to do it ?

i'm having trouble while adjusting the token rate limit because the maximum rate limit is 1k in my account
Jason 0 Reputation points

2025-01-31T01:14:59.2566667+00:00

Also i cannot adjust/modify for another open AI Model and cannot lower the token rate limit, cannot modify the 1 k token rate limit
Jason 0 Reputation points

2025-02-04T03:00:18.73+00:00

Can anyone assist me? This issue is still occurring, and my free trial is about to end

Share via

Issue with Token Rate Limit when Uploading Files to OpenAI Playground

Your answer