How to auto-authenticate AML compute instance to start on a regular schedule?

Caiwen Wu 0 Microsoft Employee

Hi, I am trying to use Azure ML workspace to run Python notebooks on a regular basis to query Kusto data and conduct data processing. I created a Compute instance in AML, set up the starter shell script, and configured the Startup schedule of the compute instance. I also used User assigned identity as the authentication method. However, the Compute instance does not always start successfully with the schedule, when it failed, a banner would appear: "Your compute needs to be authenticated before you can mount data to it. Please use the authenticate button to sign in to receive the authentication token." How can I resolve it? Thank you!

Vikram Singh 415 Reputation points Microsoft Employee

2025-01-17T06:51:43.1166667+00:00
Hello @Caiwen Wu ,

Thanks for posting your question in Microsoft Q&A, apologize for any inconvenience caused on this.

To resolve authentication issues with Azure ML compute instances during scheduled startups, please ensure that your User Assigned Identity has the necessary permissions. Additionally, verify that your startup script includes the correct authentication code. To assist in troubleshooting, kindly provide the authentication code snippet and relevant logs.

In the meantime, you can update your authentication method using the following example:

from azure.identity import ManagedIdentityCredential from azure.kusto.data import KustoClient, KustoConnectionStringBuilder # Authenticate using User Assigned Identity credential = ManagedIdentityCredential(client_id='YOUR_USER_ASSIGNED_IDENTITY_CLIENT_ID') # Set up Kusto connection kusto_cluster = "https://<your-kusto-cluster>.kusto.windows.net" kusto_database = "<your-database>" kcsb = KustoConnectionStringBuilder.with_aad_managed_identity(kusto_cluster, credential) client = KustoClient(kcsb) # Now you can run your queries

This code sample demonstrates how to authenticate using a User Assigned Identity and set up a connection to an Azure Data Explorer (Kusto) cluster. Please update the client_id, kusto_cluster, and kusto_database with your specific details.

Also let me know if it helped!

Thank you
Caiwen Wu 0 Reputation points Microsoft Employee

2025-01-18T03:20:55.28+00:00
Hi @vikram singh , thanks for your help! I tried the authentication code above but hit an error.

Here is what I used in my python script. It works fine if I manually start the Compute instance to run the notebook, however, for scheduled startups, it will fail in the middle of the notebook and the banner would pop up on the Compute page: "Your compute needs to be authenticated before you can mount data to it. Please use the authenticate button to sign in to receive the authentication token." Any thoughts on how to resolve that? Thank you very much!

from azure.kusto.data import KustoClient, KustoConnectionStringBuilder # Set up Kusto connection kusto_cluster = "https://exptelemetrysds.westus2.kusto.windows.net/" client_id = "<YOUR_USER_ASSIGNED_IDENTITY_CLIENT_ID>" kusto_database = "FRED" KustoConnectionStringBuilder.with_aad_managed_service_identity_authentication(kusto_cluster, client_id) client = KustoClient(kcsb)
Caiwen Wu 0 Reputation points Microsoft Employee

2025-01-18T03:21:51.2066667+00:00

BTW when I search online, I can't find this syntax for Python: kcsb = KustoConnectionStringBuilder.with_aad_managed_identity(kusto_cluster, credential).

Share via

How to auto-authenticate AML compute instance to start on a regular schedule?

Your answer