Azure PromptFlow Tool Function - AI Response Problem

Question

Dear All,

I used Tool Function sample of Azure ML Promptflow, as you see that <<After the first dialog, the problem starts in the dictionary it returns, it prints all the text that the user should not see into content.>>
Used Model: ChatGPT4o
Api Version: 2023-07-01-preview

Answer 1

Hi Deniz PEKŞEN

I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer.

Ask: Azure PromptFlow Tool Function - AI Response Problem

Solution: The issue is resolved. That You made the following change. It seems that working well now.

old:

# assistant:
{{item.outputs.llm_output}}

new:

# assistant:

{{item.outputs.llm_output.content}}

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

 

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Thank You.

Answer 2

Hello [Deniz PEKŞEN],

Thank you for posting your question in the Microsoft Q&A forum.

The issue of unintended text exposure in the content field when using the Tool Function sample in Azure ML Promptflow with ChatGPT-4 can be addressed by filtering and sanitizing the model's response, using custom prompt templates, upgrading to a stable API version, leveraging Azure ML Promptflow's built-in features, and enabling debugging and logging. By implementing these solutions, you can ensure that only relevant and user-appropriate content is displayed, enhancing the user experience and maintaining the professionalism of your application.

Microsoft’s comprehensive documentation provides detailed guidance on configuring and using Azure ML Promptflow, Azure OpenAI Service, and related tools to build robust and secure conversational AI solutions.

Key Documentation References:

https://learn.microsoft.com/en-us/azure/machine-learning/monitor-azure-machine-learning?view=azureml-api-2

https://learn.microsoft.com/en-us/azure/ai-services/openai/reference

https://learn.microsoft.com/en-us/azure/machine-learning/monitor-azure-machine-learning?view=azureml-api-2

 

Please, let me know the response helps answer your question? If the above answer helped, please do not forget to "Accept Answer" as this may help other community members to refer the info if facing a similar issue. 🙂

Answer 3

Hi,
I made the following change. It seems that working well now.

old:

# assistant:
{{item.outputs.llm_output}}

new:

# assistant:
{{item.outputs.llm_output.content}}