Azure Open AI GPT 4o Mini - Image Input - Token Limitation Error

Rahul Verma 5

We have a standard subscription. Every time, we try to use the API for any image analysis, we get token limit error. See the attached image. I am using a highly scaled down image. 431x391, 29KB in size.

Screenshot 2024-12-04 at 13.50.16

Saideep Anchuri 705 Reputation points Microsoft Vendor

2024-12-04T10:43:13.51+00:00

HI Rahul Verma

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

It seems that the token limit error you are encountering when using the Azure OpenAI GPT-4o Mini for image analysis may be due to the way tokens are calculated for image processing. each image is resized and divided into tiles, which then contribute to the total token cost. For GPT-4o Mini, each 512 x 512 pixel tile costs 5667 tokens, in addition to a base token cost. your image is 431x391 pixels, it will be resized and may still result in a token calculation that exceeds your current limits.

Kindly refer the below documentation: https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits

Thank You.
Saideep Anchuri 705 Reputation points Microsoft Vendor

2024-12-05T07:52:17.7+00:00

HI Rahul Verma

Following up to see if the given response was helpful.

Thank You.
Rahul Verma 5 Reputation points

2024-12-06T08:36:49.3933333+00:00

Thank you for sharing your notes. Regrettably, this appears to be an unrelated issue. The number of tokens was below 1500, and I had not accessed the 4o mini API for 24 hours. I continue to encounter the same error. Notably, when I utilize the GPT 4o API, everything functions as expected. Additionally, I have observed other users on this platform who have expressed similar concerns.
Saideep Anchuri 705 Reputation points Microsoft Vendor

2024-12-09T04:36:18.7333333+00:00

HI Rahul Verma

Just checking in to see if the below answer provided by @Max Lacy helped.

Thank You.
Max Gerlach 0 Reputation points

2025-01-03T23:49:24.6366667+00:00

I have the same issue. For the 4o model it works, but for 4o-mini i get the same quota error even when the image is very small. I tried many different Tokens per Minute Rate Limit too.

1 answer

Max Lacy 340 Reputation points

2024-12-06T15:59:32.08+00:00

I understand you are experiencing a limit issue when trying to utilize Open AI GPT 4o Mini specifically for image input. The error message "Requests the ChatCompletions_Create Operation under Azure OpenAi API version 2024-10-01 -preview have exceeded token rate limit of pricing if you would like to further increase the default rate limit..." can be misleading in that it points the user to a quota increase link.

When a deployment is created, the assigned TPM will directly map to the tokens-per-minute rate limit enforced on its inferencing requests. A Requests-Per-Minute (RPM) rate limit will also be enforced whose value is set proportionally to the TPM assignment using the following ratio:

6 RPM per 1000 TPM.

When you created your AI GPT 4o Mini deployment the TPM was likely set to a different threshold than the GPT 4o TPM threshold resulting in different RPMs rate limits for each.

To increasing your token per minute in the Azure AI Portal. Navigate to Deployments | <select deployment> | Edit.

If you found this answer helpful, consider accepting it.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure Open AI GPT 4o Mini - Image Input - Token Limitation Error

1 answer

Your answer