Azure AI Search and Open AI not integrating

Question

I have created Azure AI Search index and providing that as data source to Open AI but I get following error for the user prompt through API it works on the playground sometimes

message": {
                "role": "assistant",
                "content": "The requested information is not available in the retrieved data. Please try another query or topic.",
                "end_turn": true,
                "context": {
                    "citations": [],
                    "intent": "[]"
                }
            }

Answer 1

Hi Amit Gaonkar,
Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.  

This typically indicates that Azure OpenAI is unable to retrieve relevant data from your AI Search index.  

Please follow these steps to troubleshoot:

• Use Search Explorer in the Azure portal to verify if the expected data is present in the index.
• Ensure necessary fields in the index are marked as searchable and retrievable.
• If using an indexer with Azure Blob Storage or SQL, check that it is running successfully without errors.
• In Azure OpenAI Studio, confirm that the correct AI Search service and index are linked under RAG settings.
• Use Application Insights to check logs for any query errors or missing data issues.
• If using Vector or Hybrid Search, experiment with higher top values (e.g., top=5 or top=10) to retrieve more results. Also, check if queryType="full" improves results for keyword searches.
• one prompt does not yield results, experiment with different variations. 

I hope this information helps.

Answer 2

Hi Amit Gaonkar,
Yes, you can provide prompts like "Could you look into the attached data and summarize the information on emails?" and send follow up queries like "Please look it up again.", or "Put it in 50 words or chunks." To ensure your assistant responds correctly, make sure it can process attachments, maintain context for follow-ups, and follow word limits. You can improve accuracy by setting clear system instructions, like asking it to summarize concisely or refine previous responses based on user feedback. If needed, you can also structure prompts dynamically to make them clearer for the AI. For more information: Structured outputs

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful.