LookUp node retrieving identical chunk multiple times

Question

Hi!

I am using Azure AI Studio for creating a RAG chatbot inside prompt flow on web UI. I have a problem with the lookup node which searches for the relevant documents. Sometimes it retrieves the same chunk 5 times ( which is my top_k ). This doesn't make much sense. Is there something I may be doing wrong? Can anyone help me with this?

Answer 1

Hello Matej Jakubčík,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you would like to resolve your LookUp node that's retrieving identical chunk multiple times.

• You have to tweak the retrieval parameters, for an instance, you might want to adjust the top_k value or the similarity threshold to ensure more diverse results.
• Check your that your index is correct, and there are no duplicate entries in your index.
• Double-check the configuration of your lookup node. Make sure that it is set up to retrieve distinct chunks and that any deduplication settings are enabled.
• Make sure that the model you are using for the lookup is up-to-date and properly trained to handle the diversity of your documents.

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

---

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.