Retrieving Evaluation Metrics from Azure AI Studio using C#

Question

I am working on fetching evaluation metrics like groundedness and coherence from Azure AI Studio using C#. The Microsoft documentation provides Python code, but I couldn't find equivalent C# examples. I have tried using the Metrics library for C#, but it didn't meet my expectations.

I would appreciate any guidance or code examples in C# that could help me retrieve these metrics from Azure AI Studio. If you have experience with similar tasks or know of any C# libraries that support this, please share your insights. I am specifically looking for technical solutions and code examples.

Answer 1

@Saravan S AFAIK , there's no official C# library or direct API call currently available to fetch evaluation metrics like groundedness and coherence from Azure AI Studio as of today.

An alternative solution is exploring Azure Machine Learning Studio (AML Studio). While Azure AI Studio focuses on a user-friendly interface, AML Studio offers a more developer-centric experience.If your experiments are already deployed as web services in AML Studio, you can potentially access evaluation metrics through its REST API.The AML Studio API supports C# libraries like Microsoft.Azure.MachineLearning.Client. You'd need to explore the specific API calls to retrieve the desired metrics. Reference for AML Studio API can be found here: https://learn.microsoft.com/en-us/azure/machine-learning/?view=azureml-api-2

Best,

Grace