Unsupported credential error from azure.ai.inference to use Llama

strawberrybfs 0

Hi, I was trying to use Llama model following this tutorial:

https://learn.microsoft.com/en-us/azure/ai-studio/how-to/deploy-models-llama?tabs=python-llama-3-2%2Cmeta-llama-3-1&pivots=programming-language-python

However, I'm not sure if my credential is correct. I'm using the following format where your-host-name is my AZURE_INFERENCE_ENDPOINT is target in the screenshot and AZURE_INFERENCE_CREDENTIAL is the key in the screenshot. Then I had this error "TypeError: Unsupported credential: "

Can anyone help? Thank you!

Screenshot 2024-11-23 at 9.09.32 PM

client = ChatCompletionsClient( endpoint=os.environ["AZURE_INFERENCE_ENDPOINT"], credential=AzureKeyCredential(os.environ["AZURE_INFERENCE_CREDENTIAL"]), )

Avinash Devarakonda 330 Reputation points Microsoft Vendor

2024-11-25T06:49:25.6433333+00:00
Hi strawberrybfs,

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

The error "TypeError: Unsupported credential" suggests that the credential you are using may not be compatible with the ChatCompletionsClient. In your case, you are using AzureKeyCredential, which is appropriate for endpoints that require a key for authentication.

if your model was deployed with Microsoft Entra ID support, you should use DefaultAzureCredential instead of AzureKeyCredential. This is particularly important if your endpoint does not require a key.

Here’s how you can modify your client initialization:

from azure.identity import DefaultAzureCredential client = ChatCompletionsClient( endpoint=os.environ["AZURE_INFERENCE_ENDPOINT"], credential=DefaultAzureCredential(), )

Make sure that your endpoint was deployed with Microsoft Entra ID support and that you have the required permissions to invoke it.

Thank You.

Share via

Unsupported credential error from azure.ai.inference to use Llama

Your answer