How to get the Charts using the Azure AI Assitance?

Question

Hi Team,

I need to get the charts using Azure AI Assistance.

I need the javascript code as a response. Which should I pass to my HTML where charts should be displayed?

I want to display the Pie chart, bar charts and graph charts.

Answer 1

Hi Koteshwara R, in the current implementation above, system doesn't understand the format of submitted tools options. It should be fed to Assistants API as a list of Python functions and then a dictionary, if you want to use it through Python SDK. When doing RESTful calls, it requires more efforts as the backend has to rely on something to identify required tool to use.

Simple implementation of tools / functions with Python SDK can be found on my GitHun repo here: https://github.com/LazaUK/AOAI-ParallelFunctionCalling-SDKv1.

In your scenario if you require a chart, rather then asking for a JavaScript code generation, you can enable "Code Interpreter" tool. It would use then Python in its sandbox environment to generate an image of chart, that you can feed to your Web page. Sample code of such chart generation can be found in AOAI Assistants doc page here: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/assistant#download-image.

Answer 2

Hello Koteshwara R, functions or tools should be defined in specific format, so that they can be re-used by GPT-x models or their implementation through Assistants API.

You can find an example on simple tooling in my GitHub repo here https://github.com/LazaUK/AOAI-ParallelFunctionCalling-SDKv1.

If you want to produce charts, then you should use "Code Interpreter" as a tool. It would use then Python in its internal sandbox to generate a chart, that can be returned to you as an image. Rather than using a JavaScript code, you can feed that image to your Web site with Assistant generated chart. You can find some samples on its use in AOAI Assistants documentation page here: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/assistant#download-image.