How to do A/B test on Azure

Michael Dong 40 Reputation points Microsoft Employee
2025-01-01T19:21:49.8+00:00

Hi Team,

I want to deploy fine-tuned Qwen2.5B model on Azure, how do I do A/B test or online experiment for model version A and model version B ?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,060 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,022 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Marcin Policht 30,985 Reputation points MVP
    2025-01-01T20:57:40.5266667+00:00

    Follow https://learn.microsoft.com/en-us/azure/machine-learning/how-to-safely-rollout-online-endpoints?view=azureml-api-2&tabs=azure-cli


    If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.

    hth

    Marcin

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.