Troubleshooting Azure AI Evaluation Schedule

Alok Shukla 0 Reputation points
2024-12-03T12:34:42.3666667+00:00

Facing difficulties in tracing the Azure AI evaluation for continuous monitoring. A schedule has been created, but unable to query the evaluation results. Additionally, seeking guidance on how to check the evaluation results in Application Insights. The evaluation schedule was created based on the information in this article: Azure AI Studio Online Evaluation.

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,970 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Alok Shukla 0 Reputation points
    2024-12-04T06:29:16.1266667+00:00

    Hi @YutongTie-MSFT . Thanks for responding.

    In am using Online Evaluation with Azure AI Project SDK for creating the schedule as discussed in the article. I followed same steps as discussed in the article.

    I want to know followings:

    1. what query should be written to fetch the evaluation schedule and its results.
    2. How and where to check the already existing schedule status(i.e whether its failed in execution or it running and if failed what caused it to fail)
    3. cant i trigger it with crontrigger and if yes then how as i tried creating a cron trigger but i am not able to create as the .as_dict() method of crontrigger is not working.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.