This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 63%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Trying to test a request with o3-mini models but encountering the following error:
"error":
{
"code": "InternalServerError", "error":
{
"code": "InternalServerError",
"message": "Gateway cannot authenticate upstream services. Please contact Microsoft for help."
},
Other models like 4o and Deepsek R1 are working fine. The same issue occurs in the Foundry playground:
InternalServerError: Gateway cannot authenticate upstream services. Please contact Microsoft for help. | Apim-request-id: 0eb8749f-35fd-4d98-b3ee-6693999e25bf
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 15%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Is your Azure AI foundry resource protected with virtual network.
I checked a public OpenAI resource for 03 min in East Us 2, was able to get response in time.
Could you confirm your region too.
Thank you.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 62%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIP%3C/text%3E%3C/svg%3E)
I'm getting the same error.
How to check resource protected with virtual network?
Deployment type: Global Standard
Resource location: East US 2
As @Rizki Susanto mentioned, other models are working fine, even in playground.
Hi Rizki Susanto and Ibis Prevedello
You can check for availability of private endpoint or firewall whitelisting with selected virtual network from firewall setting of your Azure OpenAI or foundry from portal.azure.com
I am able to get answer the answer slowly and bit faster while adjusting max_tokens and reasoning in a public resource.
If the resource is virtual network, we might need to do additional whitelisting of hosts in org firewall or azure firewall, or proxy
If it is originating from SDK or API usage, please make sure you are sending correct header including the API key and endpoint
If it is a backend issue, please try again later to see if it is intermittent issues
Thank you.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 20%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
Could you please share the below details in private message.
Networking firewalls have been set to allow requests from all networks as shown above. I'm using East US 2 as a region and Global Standard for deployment type.
Are you using "Add your own data scenario" somehow with your 03 model.
It is not a supported featured for o3 and o1 models yet.
Thank you.
Hi
I didn't make any changes/settings to the deployed model, I directly deployed with the conditions that were automatically filled in by azure. I can say that this is a fresh deployment, but it doesn't work if I request on the playground or using the API.
Thanks!
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 52%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJS%3C/text%3E%3C/svg%3E)
Hi @Rizki Susanto ,
I have tried to reproduce the issue, but i am able to get results successfully in the same region you mentioned.
Also, got results while using sdk.
Please try it again with fresh deployment using below sdk code once and let me know the results.
import os
import base64
from openai import AzureOpenAI
from azure.identity import DefaultAzureCredential, get_bearer_token_provider,ClientSecretCredential
endpoint = os.getenv("ENDPOINT_URL", "<your_endpoint>")
deployment = os.getenv("DEPLOYMENT_NAME", "o3-mini")
subscription_key = os.getenv("AZURE_OPENAI_API_KEY", "Api_key")
client = AzureOpenAI(
azure_endpoint=endpoint,
api_key=subscription_key,
api_version="2024-12-01-preview",
)
chat_prompt = [
{
"role": "user",
"content": "give me details of bank."
}
]
messages = chat_prompt
completion = client.chat.completions.create(
model=deployment,
messages=messages,
max_completion_tokens=100000,
stop=None,
stream=False
)
print(completion.to_json())
Thank you
After redeploying it seems to work now. However, this will create a new resource which is a bit confusing. Maybe Azure can consider simplicity regarding endpoint deployment so that it is on the same endpoint.