Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,054 questions
1 answer
How to do A/B test on Azure
Hi Team, I want to deploy fine-tuned Qwen2.5B model on Azure, how do I do A/B test or online experiment for model version A and model version B ?
asked 2025-01-01T19:21:49.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 38%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMD%3C/text%3E%3C/svg%3E)
Michael Dong
20
Reputation points Microsoft Employee
answered 2025-01-01T20:57:40.5266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 38%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Marcin Policht
30,740
Reputation points MVP
1 answer
Which open source LLM do we support ?
I have fine tuned some open source models like LLama-3.1, Qwen2.5. My question is that: is Azure able to serve all the fine-tuned open source models ? If not, which models are supported ?
asked 2025-01-01T18:46:56.8533333+00:00
Michael Dong
20
Reputation points Microsoft Employee
answered 2025-01-01T19:52:45.61+00:00
Marcin Policht
30,740
Reputation points MVP
0 answers
How to do A/B test for LLM serving
Hi Team, I want to deploy fine-tuned LLM like Qwen2.5 model on Azure, how do I do A/B test experiment ? Assume I haver model version 1 and model version 2.
asked 2025-01-01T19:23:54.43+00:00
Michael Dong
20
Reputation points Microsoft Employee
asked 2025-01-01T19:23:54.43+00:00
Michael Dong
20
Reputation points Microsoft Employee
0 answers
What is the latency and cost of A100 gpu
Hi team, I want to deploy fine-tuned model on Azure. If I use llama3.1-8b model, the input is 4k token and output is 512 token. What is the latency if I deploy the model to A100 gpu ? What is the economy cost for each A100 gpu ? Do we support vllm…
asked 2025-01-01T19:18:54.6733333+00:00
Michael Dong
20
Reputation points Microsoft Employee
asked 2025-01-01T19:18:54.6733333+00:00
Michael Dong
20
Reputation points Microsoft Employee
0 answers
How to do the load balancer, tracking event and log
Hi Team, I want to deploy my fine-tuned LLM like Qwen2.5 model to Azure: How do you do the load balancer between different host or gpus ? How do you record the tracking and log on the Azure disk space ?
asked 2025-01-01T19:15:49.6666667+00:00
Michael Dong
20
Reputation points Microsoft Employee
asked 2025-01-01T19:15:49.6666667+00:00
Michael Dong
20
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
In Azure ML studio deploy option is not there
Hi team im new to Azure ML studio in that i done trained data but i would like to deploy im in trial account i dont see option for deploy i can able to see only submit , share like that only please help
asked 2023-04-01T08:41:30.8066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 66%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMP%3C/text%3E%3C/svg%3E)
Manoj P
30
Reputation points
commented 2025-01-01T12:59:37.37+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 8%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVY%3C/text%3E%3C/svg%3E)
Vijayalakshmi Yuvaraj
0
Reputation points
0 answers
Cannot Deploy AutoML Endpoint
Hello, Thanks in advance for the help here, I am pretty confused about what config could be missing! I am working through some tutorials on Azure Auto ML, I trained an Automl endpoint and then tried to deploy it and I get the following errors: Resource…
asked 2024-12-27T19:13:05.2466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 61%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG%3C/text%3E%3C/svg%3E)
gwinner
0
Reputation points
commented 2024-12-31T16:09:03.8866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 20%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKS%3C/text%3E%3C/svg%3E)
kothapally Snigdha
835
Reputation points Microsoft Vendor
1 answer
Azure Machine Learning Studio creates v1 deployments that can't be tested in Studio
If you use AutoML in Azure Machine Learning Studio to train a model and then deploy that model to an Azure Container Instance, you can't test the deployment using Studio. When you click on the Test tab, it comes back with "This deployment is based…
asked 2024-12-30T15:33:39.1266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 15%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGH%3C/text%3E%3C/svg%3E)
Guy Hummel
0
Reputation points
commented 2024-12-31T10:50:16.1433333+00:00
Guy Hummel
0
Reputation points
0 answers
"Error 'Resource provider not registered' when deploying model in Azure ML Tutorial (Free Trial)"
Hi, I'm following the Microsoft Learn tutorial "Create a classification model with Azure Machine Learning designer" (https://microsoftlearning.github.io/mslearn-ai-fundamentals/Instructions/Labs/01-machine-learning.html) with an Azure Free…
asked 2024-12-21T01:33:59.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 69%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EY%3C/text%3E%3C/svg%3E)
YUTA
5
Reputation points
edited a comment 2024-12-31T06:23:24.4+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 24%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENM%3C/text%3E%3C/svg%3E)
navba-MSFT
27,080
Reputation points Microsoft Employee
1 answer
How to cancel a hanging Custom Vision training iteration
A Custom Vision training iteration was started 4 days ago with a 4-hour reserved budget, but it still shows as training. Retraining and exporting the project are not possible until this iteration stops hanging. What are the recommendations for canceling…
asked 2024-12-30T15:58:07.4566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 1%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
bjsmiley
0
Reputation points
edited a comment 2024-12-31T04:56:01.1633333+00:00
romungi-MSFT
48,231
Reputation points Microsoft Employee
1 answer
Calling Hugging Face inference APIs from Azure ML
Good Day, Is that possible to call HuggingFace endpoints API (for the warm inference) without deploying the model itself from Azure ML? Thank you
asked 2024-12-26T12:05:46.5166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 53%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMH%3C/text%3E%3C/svg%3E)
Mohamed Hussein
550
Reputation points
commented 2024-12-30T09:04:50.2033333+00:00
romungi-MSFT
48,231
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to fix memory has been exhausted error in Azure Machine Learning Studio in Convert to Indicator Values module
When I am running a pipeline that I created in Azure Machine Learning Studio, it is for some reason giving me the following error: Execution failed. User process '/azureml-envs/azureml_862fbd3b8df44d2c582aa46cf5a23700/bin/python' exited with status code…
asked 2024-12-27T22:20:12.2266667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 97%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELJ%3C/text%3E%3C/svg%3E)
Lakshya Jain
20
Reputation points
accepted 2024-12-29T23:02:10.9366667+00:00
Lakshya Jain
20
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure CLI ERROR when add extensions: An error occurred. Pip failed with status code 1
Hi everyone I'm trying to add extensions in Azure CLI with the command: az extension add --name subscription however I get the following message: An error occurred. Pip failed with status code 1. Use --debug for more information. Here the debug…
asked 2023-12-01T05:55:00.18+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 62%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECO%3C/text%3E%3C/svg%3E)
Carlos Ochoa Medrano
40
Reputation points
commented 2024-12-29T16:11:15.7966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(198.4, 50%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sharma Kamal Kumar
1
Reputation point
1 answer
One of the answers was accepted by the question author.
why Import data assets (preview) feature not available in West Europe?
Hi, Many features in preview are not available for the region West Europe. How can I check whether it is available in the region and if it is available, how to enable for my subscription? For example, Import data assets (preview) option is not showing in…
asked 2024-12-15T13:05:30.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 89%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Boopathi Sarvesan
20
Reputation points
edited the question 2024-12-29T12:29:13.0633333+00:00
TP
101K
Reputation points
1 answer
One of the answers was accepted by the question author.
Error while creating a managed online endpoint in azure machine learning studio
while creating a managed online endpoint in azure machine learning studio I get the following error in my workspace's notebook: --------------------------------------------------------------------------- OperationFailed Traceback (most recent call last)…
asked 2024-08-23T21:29:59.2566667+00:00
Matias Larsson
85
Reputation points
commented 2024-12-27T23:52:24.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 1%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
YutongTie-MSFT
53,716
Reputation points
1 answer
One of the answers was accepted by the question author.
Cannot deploy an endpoint for AutoML model. Can someone help?
I am having trouble with deploying a model I created using AutoML. I have no coding/programming experience at all, so I'm completely confused. None of the "support documentation" provided for Azure helps resolve the issue at all. I've…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(214.4, 47%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EG%3C/text%3E%3C/svg%3E)
2 answers
Set up as Workspace Owner and Data Scientist role, but cannot create notebooks/write files
I just set up a Workspace under my Subscription, and am the Owner on both. I'm trying to work in Azure ML in this Workspace, where I have a Azure ML Data Scientist role for myself as well, and keep getting this message when I try to create a new…
asked 2024-12-11T17:33:08.7733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 33%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Stephen
5
Reputation points Microsoft Employee
edited a comment 2024-12-26T08:45:02.06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 3%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Manas Mohanty
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Which registry should I use for MLOps?
Hi there, I want to set up MLOps CI/CD pipeline, which registry should I use for MLOps(Azure Container Registry or Azure Machine Learning Registry)? And what are the best practices for MLOps? Thanks®ards, zmsoft
1 answer
One of the answers was accepted by the question author.
Why can only a Compute instance of Azure Machine Learning be assigned to one user
Hi there, Why can only a Compute instance of Azure Machine Learning be assigned to one user? How to share with other users? Thanks&Regards, zmsoft
asked 2024-12-26T03:42:14.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
zmsoft
240
Reputation points
commented 2024-12-26T07:27:24.9+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(281.6, 88%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Saideep Anchuri
705
Reputation points Microsoft Vendor
1 answer
I get 401 error when I test the mode externally.
when I test the model on postman or by usin python code by both methord i am getin the same output 401 error , it says "401 key_auth_access_denied" . where is the problem
asked 2024-12-25T20:07:41.38+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 90%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Anuj Kumar
0
Reputation points
answered 2024-12-26T01:30:11.6433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 4%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Sina Salam
14,931
Reputation points