Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,638 questions
Getting the following error: Backend returned unexpected response. Please contact Microsoft for help
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 87%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Asadbek Sindarov
0
Reputation points
Hi, I have been trying to deploy Llama-3.3-70B-Instruct model on azure ai foundry and use it on our RAG implementation. When I try to use chat completion service I am getting the following error: Error code: 500 - {'error': {'code': 'InternalServerError', 'message': 'Backend returned unexpected response. Please contact Microsoft for help.'}}. I am using Azure.AI.OpenAI nuget package. I have tried using direct api calls and open ai rest api seems to be working fine. Probably there is an issue with the nuget package implementation related to llama model or something. Can you please help us with this ?
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 88%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Saideep Anchuri 1,950 Reputation points Microsoft Vendor2025-02-11T08:06:25.36+00:00 I am able to get results with sample javascript code with latest node js in sweden central. Could you check in Sweden central. Please provide your package version and region to repro here.
Thank You.
Sign in to comment
Sign in to answer