Azure Open AI Vision Issues - East US - GPT-4o

Adriaan 35

Hi there,

Are we aware of any issues occurring on the East US resources for Azure Open AI? Specifically concerning GPT-4o and vision.

Prompting our 4o and 4o mini deployments on our East US resource with images results in the following exceptions being thrown:
error1

error2

Kindly advise.

navba-MSFT 24,985 Reputation points Microsoft Employee

2024-08-08T09:48:31.3733333+00:00

@Adriaan Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.
I tried with both GPT4o and GPT4o-mini in East US region and both appears to be working.

.

This seems like a transient issue and no issues are reported now in East US region.

You could also check this from your end from the Azure Portal --> Service Issues section:
https://portal.azure.com/#view/Microsoft_Azure_Health/AzureHealthBrowseBlade/~/serviceIssues

.

Please clear the browser cache and try again to check if that works.

.

Hope this helps.
Adriaan 35 Reputation points

2024-08-08T09:58:13.7333333+00:00

Hi there,

Thanks for the swift reply.

Can you see if you can replicate this issue with text heavy images? For example a page from an invoice with at least 5 or 6 line items?

I can consistently replicate this issue with images like that.
Our other resources in other locations such as Sweden do not have this issue.

Many thanks,

Adriaan
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-08-08T10:00:18.4666667+00:00

@Adriaan Please share the image which you are using as a private message. So that I can test at my end. I have sent you a private message.
Adriaan 35 Reputation points

2024-08-08T10:14:52.49+00:00

Here is an example of a text heavy image that causes this issue on our deployments.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-08-09T04:31:50.88+00:00

@Adriaan I tried again with your above images in East US with both GPT4o and GPT4o-mini and it worked just fine.

This seems like a transient issue and no issues are reported now in East US region.

You could also check this from your end from the Azure Portal --> Service Issues section: https://portal.azure.com/#view/Microsoft_Azure_Health/AzureHealthBrowseBlade/~/serviceIssues

.

Please clear the browser cache and try again to check if that works.

If you encounter the same issue, again, please let me know. I would be happy to assist you further.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Shaun Britz 0 Reputation points

2024-08-14T09:54:02.96+00:00

I am currently also facing the same issue
I am using GPT-4o v.2024-05-13
The issue seems to be intermittent.
Adriaan 35 Reputation points

2024-08-14T09:58:55.8933333+00:00

As per Shaun, we are experiencing this issue again.
Mohamed Siddique Sayed 0 Reputation points

2024-08-14T10:04:47.0133333+00:00

Hi there,

I seem to be experiencing the same issue discussed above on the East US resources for Azure Open AI, specifically concerning GPT-4o and vision.
Mohamed Siddique Sayed 0 Reputation points

2024-08-14T12:14:12.86+00:00

Hi there,

I see it came right for a while and now it is down again.

Kindly assist.
Adriaan 35 Reputation points

2024-09-05T06:35:42.97+00:00

Since last night we are experiencing this issue once again. Even standard text prompting is incredibly slow and tends to timeout. This is mostly evident with very large prompts, 20000+ input tokens.
This is occurring on our Azure OpenAI resources in the East US region.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-05T07:12:40.78+00:00

@Adriaan I have sent you a private message asking for more details. Please share the details with me.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-06T04:46:02.1+00:00

@Adriaan Please share the requested details over private message. This will help us to assist you better.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-09T06:39:27.2066667+00:00

@Adriaan We are still investigating. I will keep you posted about my findings.
Adriaan 35 Reputation points

2024-09-12T07:16:52.97+00:00

It could be that we are hitting our rate limit, but there is no corresponding exception or status code returned. The connection simply times out as described in previous messages.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-12T07:21:30.19+00:00

@Adriaan I have followed up earlier this morning and asked for the updates from product Owners. I am yet to hear from them.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-13T03:47:28.42+00:00

@Adriaan On 2024-09-13 00:06:39 UTC, I could see many 429 error codes ( about 50,000 requests approximately) failed. That is too much of a requests. This will result in throttling and latency (performance and timeout issues). The only fix for the 429 errors in to be within the requests limits.

I am still working internally for the timeout issues that you had faced on Sept 5th.
Adriaan 35 Reputation points

2024-09-13T07:23:04.67+00:00

@navba-MSFT Thank you. Yes, we caught that as well, we have implemented some more restrictions from our side.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-18T05:18:51.9133333+00:00

@Adriaan Just following up to check if the below answer helped. If that answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let me know. I would be happy to help.

1 answer

navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-16T05:29:32.66+00:00

@Adriaan I got my analysis verified by the Product Owners for the timeout (latency performance issue) that was observed between 04/09/2024 18:00 UTC and 05/09/2024 18:00 UTC.

.

We see surge of 429s across all customers during above time window, and these correlate with 503s in our internal logs. Engine also consistently raised 500 errors. The issue was due to the error 429 due to exceeding the request rate limits. The only fix for the 429 errors in to be within the requests limits.

.

The request limits have been mentioned clearly in this article.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.

1 person found this answer helpful.
navba-MSFT 24,985 Reputation points Microsoft Employee

2024-09-17T03:07:10.72+00:00

@Adriaan Just following up to check if the below answer helped. If that answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let me know. I would be happy to help.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure Open AI Vision Issues - East US - GPT-4o

1 answer

Your answer