How to disable Azure Databricks Personal Compute policy?

Anita A 110

Hello, can you please provide details how to disable Azure Databricks Personal Compute policy for
a) all users
b) non-admin users Thanks!

Anita A 110 Reputation points

2023-04-24T15:05:34.11+00:00

I got notification that there’s a new answer, but I am not seeing anything in here.
RevelinoB 3,440 Reputation points

2023-04-24T15:58:48.0533333+00:00
Sure, here's how you can disable the Azure Databricks Personal Compute policy for all users or non-admin users: To disable the Personal Compute policy for all users:

Sign in to the Azure portal and navigate to your Databricks workspace.

Click on "Compute" in the left-hand menu, and then select "Policies".

Locate the "Personal Compute" policy and click on the policy name to view the policy details.

Click on the "Disable" button to disable the policy for all users. To disable the Personal Compute policy for non-admin users:

Follow steps 1-3 above to locate the "Personal Compute" policy.

Click on the "Scope" tab to view the policy scope.

Click on "Add" to add a new scope.

Select the "Exclude" option and choose the "Users and groups" scope type.

Select the non-admin users or groups that you want to exclude from the policy.

Save your changes and the policy will be disabled for the selected users or groups. Please be aware that disabling the Personal Compute policy for all users or non-admin users may affect the security and governance of your Databricks workspace. You should consider the implications carefully before making any changes to your policies.

Does these steps help you?
Anita A 110 Reputation points

2023-04-25T08:04:41.1733333+00:00

Thanks for the answer. I am an admin of the Databricks workspace but I am not seeing neither "Disable" nor "Scope" in the policy details.
RevelinoB 3,440 Reputation points

2023-04-25T08:13:16.7133333+00:00

Thanks for letting me know, In my perception, if you are not seeing the "Disable" and "Scope" options in the Azure Databricks Personal Compute policy details, it's possible that you don't have the necessary permissions to modify the policy. As an admin, you should have the necessary permissions to modify policies, but it's possible that your role may have been restricted or customized to limit your access to certain features. You can check your role in the Azure portal by going to the "Access control (IAM)" section of your Databricks workspace and checking your assigned role. Alternatively, it's possible that the Personal Compute policy has been customized or disabled at the workspace level. I hope this answer your "Disable" nor "Scope" question?
Anita A 110 Reputation points

2023-04-25T08:42:34.5733333+00:00

I am both the owner and contributor of the workspace, so how can the policy be disabled?
RevelinoB 3,440 Reputation points

2023-04-25T08:58:30.26+00:00
My apologizes for the confusion. The options to disable and scope the policy may not be available for all Databricks workspaces, depending on the policy version and the workspace configuration. If you have all the required permission, but you are unable to disable the Personal Compute policy using the policy details page, you can try disabling it using the Azure Databricks REST API. Here are the steps you can follow:

Generate a Databricks token that has the "Manage" permission. You can do this by navigating to the "User Settings" page in your Databricks workspace and creating a new token with the "Manage" permission.

Use a REST client or a programming language such as Python to send a request to the Databricks API to disable the Personal Compute policy. I hope this helps? If you have any questions please let me know.
Anita A 110 Reputation points

2023-04-25T12:36:39.8333333+00:00

Can you please point me to that API? Since what I found is the same thing that can be done form UI, just updating the policy definition
https://docs.databricks.com/dev-tools/api/latest/policies.html#operation/edit-cluster-policy

RevelinoB 3,440

Sure! Here's an example of how you can use Python to send a request to the Databricks API to disable the Personal Compute policy:

import requests
import json

# Set the Databricks API endpoint and token
api_endpoint = 'https://<databricks-instance>/api/preview/identity/policies/<policyId>'
token = '<databricks-token>'

# Define the policy definition with the "Effect" set to "Disabled"
policy_definition = {
    "policy_definition": {
        "Effect": "Disabled",
        "Actions": [
            "workspace_manage_personal_access_tokens"
        ]
    }
}

# Set the headers for the API request
headers = {
    "Authorization": f"Bearer {token}",
    "Content-Type": "application/json"
}

# Send the API request to disable the policy
response = requests.put(api_endpoint, headers=headers, data=json.dumps(policy_definition))

# Check the API response
if response.status_code == 200:
    print("Personal Compute policy disabled successfully!")
else:
    print("Error disabling Personal Compute policy:", response.content)

In the above code snippet, you should replace <databricks-instance> with the hostname of your Databricks instance, <policyId> with the ID of the Personal Compute policy you want to disable, and <databricks-token> with the Databricks token you generated with the "Manage" permission. Bye the way you can use any REST client or programming language that can make HTTP requests to send the API request. The key is to set the Authorization header with the Databricks token, the Content-Type header with "application/json", and pass the policy definition with the "Effect" set to "Disabled" in the request body. I hope this work for you? If you have any queries, please let me know.

Anita A 110 Reputation points

2023-04-25T14:17:45.5+00:00

Thanks for the reply. I can authenticate but I am getting 404Not Found. Is there any official documentation for this API link?
RevelinoB 3,440 Reputation points

2023-04-25T14:35:14.8266667+00:00

Yes, you can find the official documentation for the Databricks API on the Databricks website. Here is the link to the Databricks API documentation: https://docs.databricks.com/dev-tools/api/index.html Just to clarify, if you are getting a 404 Not Found error after running the Python script to disable the Personal Compute policy through the Databricks API, it means that the API endpoint you are trying to access does not exist or cannot be found. This error can be caused by a few potential issues, such as an incorrect API endpoint, an authentication problem with your personal access token, a permission issue, or a network problem if you are running the script from behind a firewall or proxy. To troubleshoot this error, you can check that the api_endpoint variable is set to the correct endpoint URL, ensure that the token variable contains a valid personal access token with the necessary permissions to modify policies, and verify that the user associated with the token has the appropriate permissions to access and modify the policy. I hope this helps with solving the issue?

Accepted answer

PRADEEPCHEEKATLA 90,561 Reputation points

2023-04-26T05:05:08.82+00:00
Anita A - Thanks for the question and using MS Q&A platform.

You may follow the to enable or delegate Azure Databricks Personal Compute policy.

To begin with you need switch to Manage Account from your databricks workspace.

Account admins can enable or disable access to the Personal Compute policy for all users in an account using the Personal Compute account setting.

From the account console, click Settings.

Click the Feature enablement tab.

Enable the Personal Compute setting to give all users in the account access to the Personal Compute policy. Or, switch the setting to Delegate if you want to policy to be managed at the workspace level.

For more details, refer to Manage the Personal Compute cluster policy.
Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Anita A 110 Reputation points

2023-04-26T08:35:25.5266667+00:00

Thanks for the reply, but when I click on "Manage Account" I am redirected to the same view as on the first screenshot. I am not seeing a view like on the second screenshot.

PRADEEPCHEEKATLA 90,561 Reputation points

2023-04-27T04:06:03.8666667+00:00

Anita A - Please do confirm, if you are the Global Administrator of the subscription which you are using?

The Global Administrator should use the following instructions:

Sign into your Azure Portal with your Global Admin credentials.

Go to accounts.azuredatabricks.net and sign in with Azure AD. Azure Databricks automatically creates an account admin role for you.

Then click on Settings Page and you will find the above screenshot.

If you are not a global admin, then you can ask your global admin to add you as account admin.

How to find the Global Admin and add users, check out MS Q&A thread which addressing similar issue.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Anita A 110 Reputation points

2023-04-27T10:31:52.1533333+00:00

Thanks for the answer, issue resolved.

PRADEEPCHEEKATLA 90,561 Reputation points

2023-04-28T06:59:37.66+00:00

Anita A - Glad to know that the below response was helpful. Thank you for marking this answer as accepted. This will help others find useful answers faster.

Please feel free to take a survey on the relevant answer. You can help us improve by leaving feedback verbatim.

Have a good day!

Regards,
PRADEEPCHEEKATLA-MSFT
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

3 additional answers

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Comments have been turned off. Learn more
Robert Golik (o365) 1 Reputation point

2025-03-07T14:48:58.82+00:00

My workarround:

I've edited the "personal compute" and added the "override" in policy:

{"node_type_id":
{
"type": "forbidden"
}
}

for us it works great, users cant create a Personal compute now.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to disable Azure Databricks Personal Compute policy?

3 additional answers

Your answer