Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,710 questions
Latency and Timeout Errors for Azure OpenAI o1/o3mini API request
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 10%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Simon Huang
10
Reputation points
Azure openai o1/o3mini APIs are barely usable now. Most requests result in timeout errors. it takes over 1 minute to respond a "Hi" even if you set reasoning effort to low.
Region: eastus2
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 20%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
kothapally Snigdha 1,595 Reputation points Microsoft Vendor2025-02-20T18:40:29.67+00:00 -
Pedro Castelo Branco Lourenço 41 Reputation points2025-02-21T07:44:30.28+00:00 Is there an ETA? Why if we go to Service Status it always says it is Healthy? I am facing similar issues since 3-4 days on Sweden with o1 and o3-mini. The lack of transparency and clear communication is depressing.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 64%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESL%3C/text%3E%3C/svg%3E)
Sven Leidenbach 10 Reputation points2025-02-21T07:51:44.57+00:00 It would be nice if microsoft could actually inform us about the issue at hand with key information instead of forcing users to discover the latency is an issue for everyone on the forums.
In the current status, the o3-mini models is simply unusable due to timeouts and variability in response time. I simply can't reliably use azure AI services if left in the dark like this.
Some status updates, a working status site with current expected tokens/s etc would be a good start.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 1%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
YutongTie-MSFT 53,891 Reputation points2025-02-21T17:59:59.1666667+00:00 @Simon Huang @Pedro Castelo Branco Lourenço @Sven Leidenbach Thanks for reaching out to us again, I will update you the status here daily until this issue has been mitigated, as of today, there is no ETA, but there are several tickets opening to product team and product team is investigating this issue.
For lack of announcement, I will share the feedback to the team.
Regards,
Yutong
Sign in to comment
Sign in to answer