Trouble connecting Copilot to Azure OpenAI Services

Thomas Lowrey 5

I am experiencing significant challenges in getting my Copilot to connect to Azure OpenAI Services, specifically for accessing my data index. Here’s a detailed breakdown of the steps I’ve taken and the issues I’m encountering:

Setup in Azure OpenAI Studio:

I successfully connected to my index via Azure AI Search, and I am able to perform searches (Keyword, Hybrid, and Semantic) without any issues. In the Azure OpenAI Studio, everything functions as expected. I can query the data within my index using any deployed model and retrieve the correct results.

Issues in Copilot Studio:

  - The problems arise when I attempt to deploy the configuration to Copilot Studio. After creating the Copilot, I navigate to **Conversational Boosting** within **System Topics**. When I access **Create Generative Answers** to view the data source, my index is not listed.
  
     - I attempted to resolve this by going to **Classic Data -> Azure OpenAI Services on Your Data**, where I added the connection to my Azure OpenAI Services. However, the connection properties are always empty. Despite editing these properties and testing the Copilot, it fails to access my index regardless of the configuration or model used.
     
     **Additional Attempts**:
     
        - I’ve ensured that the Azure OpenAI Services are correctly listed in my Power Apps connections.
        
           - I’ve tried rebuilding the Copilot from scratch, adding connection properties afterward, but with no success.
           
              - Both Copilot Studio and my Azure services are under the same company account, which I have verified.

Despite these efforts, I have been unable to resolve the issue. Could someone please advise on what I might be doing wrong, or if others have encountered similar difficulties?

1 answer

Sina Salam 14,551 Reputation points

2024-09-24T20:44:13.5166667+00:00

Hello Thomas Lowrey,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you are having issue with connecting your Copilot to Azure OpenAI Services for accessing your data index.

I will advise you to enable CORS for your Azure Blob Storage resource if you are using it to store your data, this is a similar situation here https://learn.microsoft.com/en-us/answers/questions/1513627/problems-integrating-azure-openai-in-copilot-studi but if the issues is not resolved, refer to these documentations https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data and https://learn.microsoft.com/en-us/microsoft-copilot-studio/nlu-generative-answers-azure-openai

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.
Please sign in to rate this answer.
RAyala 0 Reputation points

2024-09-26T16:47:45.2233333+00:00

Hello @Sina Salam I have the same issue like @Thomas Lowrey and still not working. I I have everything needed (indexes, Azure AI Search, etc) I even tried the upload file option in Azure AI, (i did CORS), but another errors was display due to the type of file I was using (pdf with images). But the thing is exactly like Thomas described. Nothing works for me in Copilot Studio Test area. I manually did fill out every parameters (that are supposed to be filled by the deployment process) but, can get an answer from my index. I will appreciate any help on this matter..

Thanks,

Rafael

Jignesh Patel 46 Reputation points

2024-12-13T11:42:50.9933333+00:00

Hi @Sina Salam

I'm facing the same issue from CoPilot Studio > Topics > Conversational Boosting > Create generative answers > Data source > Classic data.

I added OpenAI connection details with Deployment, API version etc.. & index still unable to retrieve data.

Moreover I also applied CORS Allow Origin Type to all & Allowed origins to *.

Could you plz help me.

Sina Salam 14,551 Reputation points

2024-12-13T14:21:13.1766667+00:00

Hello @RAyala, @Thomas Lowrey and @Jignesh Patel

Kindly find your challenges in the followings for official recommendations and how to troubleshoot them:

Issue: Unable to get answers from the index in Copilot Studio Test area, encountering errors with PDF files containing images.

Data Source Linking:

In the Azure OpenAI On Your Data: This section provides detailed steps on how to connect your data source using Azure OpenAI Studio. It includes information on uploading files and linking existing data sources. You can find it https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data and https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data

File Compatibility:

In the Supported Data Formats context: Ensure that your PDF files are compatible with Azure AI Search. This section outlines the supported data formats and file types. Check it here - https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data and https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data

Issue: Unable to retrieve data from the index after adding OpenAI connection details and setting CORS.

CORS Settings:

In the Configuring CORS for Azure Storage: This section provides guidance on how to configure CORS settings for your Azure Blob Storage. It includes steps to specify allowed origins and enhance security. You can find it here - https://learn.microsoft.com/en-us/answers/questions/1466700/azure-openai-cors and https://learn.microsoft.com/en-us/answers/questions/1466700/azure-openai-cors

OpenAI Connection Details:

In the Azure OpenAI Service API Reference: This section covers how to correctly set up and use the OpenAI connection details, including deployment and API version. Check it here - https://learn.microsoft.com/en-us/azure/ai-services/openai/reference https://learn.microsoft.com/en-us/azure/ai-services/openai/reference

For detailed guidance on setting up and troubleshooting Azure Cognitive Search, refer to the documentation here - https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data

Let's us know if this is helpful and don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.

Jignesh Patel 46 Reputation points

2024-12-13T17:03:43.6066667+00:00

Hi @Sina Salam ,

Primary issue has been resolved & I'm able to get data using OpenAPI. Issue which I'd related to API version. After selecting "2023-06-01-preview" version it's working fine. Still I've below questions.

I'm not sure as from Chat Playground I've API version "2024-05-01-preview" so how can I use same version in CoPilot studio?

Also some times I noticed for same question I'm getting little different answers in Chat playground and CoPilot studio

Sina Salam 14,551 Reputation points

2024-12-13T19:48:26.78+00:00

Hello Jignesh Patel,

Thank you for your response and to let us know that the primary issues has been resolved.

Kindly, accept the answer and upvote for the rest community to benefit from it. If none of these suggestions work, let us know what you've done to resolve it.

Regarding your concerns and new questions, kindly create another ticket or post, if you mentioned my name @myname I will respond to assist.

Thank you once again.

Jignesh Patel 46 Reputation points

2024-12-16T04:20:51.23+00:00

@Sina Salam

Earlier while research I'd reviewed all links which you provided earlier but in my research I found below solution.

Primary issue has been resolved & I'm able to get data using OpenAPI. Issue which I'd related to API version. After selecting "2023-06-01-preview" version it's working fine.

Thanks

Sina Salam 14,551 Reputation points

2024-12-17T15:32:06.8166667+00:00

Hello @RAyala, @Thomas Lowrey and @Jignesh Patel

Thank you @Jignesh Patel to let us know you're able to resolve the issue and some of the links in the answer are helpful.

@RAyala, and @Thomas Lowrey I'm trying to follow-up to see if you need more information and if the answer if helpful, to benefit other community users don't forget to close up the thread here by upvoting and accept it as an answer.

Thank you.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Trouble connecting Copilot to Azure OpenAI Services

1 answer

Your answer