getting error while creating mount point in data bricks

Hi,

I am getting the following error when trying to create mount point.

py4j.security.Py4JSecurityException: Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result com.databricks.backend.daemon.dbutils.DBUtilsCore.mount(java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.util.Map) is not whitelisted on class class com.databricks.backend.daemon.dbutils.DBUtilsCore

Please help me with the resolution. Thanks in advance

Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-10-25T20:06:13.51+00:00

Hi @Lakshmi Narayana Sarma Bhamidipati

Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Thank you.
Lakshmi Narayana Sarma Bhamidipati 90 Reputation points

2024-11-04T14:08:15.55+00:00

sorry for the delayed response. This solution is not working. Thanks.
Lakshmi Narayana Sarma Bhamidipati 90 Reputation points

2024-11-04T14:09:46.41+00:00

Can we create mount points in standard cluster and then use them in our other premium cluster?
Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-11-05T12:48:25.7533333+00:00

Hi @Lakshmi Narayana Sarma Bhamidipati

Yes, you can create mount points in a standard cluster and then use them in other clusters, including premium clusters, within the same Azure Databricks workspace. Mount points in Databricks are a workspace-level feature, meaning that once a mount point is created, it is accessible from any cluster within that workspace.

Important considerations:

Workspace-Level Access: Mount points created within a workspace are accessible to all clusters in that workspace, regardless of their tier (standard or premium).

Refresh Mounts: The dbutils.fs.refreshMounts() command is essential to ensure that the premium cluster recognizes the newly created mount point.

Security Considerations: Be mindful of security best practices when creating and managing mount points. Use strong credentials and consider implementing appropriate access controls.

Permissions: Ensure that the premium cluster has the necessary permissions to access the underlying storage. If you are using Azure AD passthrough, the users or service principals running the premium cluster should have access to the storage account.

Consistency: If the standard cluster is terminated or deleted, the mount point will still exist as long as the workspace is not deleted. However, changes to the underlying storage (e.g., credentials, account keys) may require remounting or updating the mount configurations.

For more details, please refer: https://learn.microsoft.com/en-us/azure/databricks/dbfs/mounts

I hope this information helps. Please do let us know if you have any further queries.

Thank you.
Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-11-06T05:07:18.6533333+00:00

Hi @Lakshmi Narayana Sarma Bhamidipati

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.
Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-11-07T06:15:18.51+00:00

Hi @Lakshmi Narayana Sarma Bhamidipati

Just checking in to see on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.
Lakshmi Narayana Sarma Bhamidipati 90 Reputation points

2024-11-08T08:01:37.0633333+00:00

we are able to access now. Thanks
Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-11-11T03:47:16.8333333+00:00

@Lakshmi Narayana Sarma Bhamidipati

Glad to know that your issue got resolved.

Please continue using Microsoft Q&A platform for further queries.

If you find my suggestion useful, feel free to click 'accept answer.' Also, if you come across any solutions, sharing them with the community would be greatly appreciated as it could benefit others.

Thank you.

2 answers

Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-10-24T19:21:16.9933333+00:00
Hi @Lakshmi Narayana Sarma Bhamidipati

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

The error you are facing is because, when utilizing a High Concurrency cluster and enabling credential pass through, this problem occurs with various library operations. When you visit a method that Azure Databricks hasn't expressly designated as safe for Azure Data Lake Storage credential passthrough clusters, this issue is raised.

For more details, please refer: https://learn.microsoft.com/en-us/azure/databricks/archive/credential-passthrough/adls-passthrough#passthrough-troubleshooting

Below are the workarounds that you may consider for resolving your query.

Use a different cluster mode as a workaround if it describes your situation.

Update spark.databricks.pyspark.enableProcessIsolation to false for this your cluster needs to be with no isolation shared access mode

Update spark.databricks.pyspark.enablePy4JSecurity to false

Use standard clusters in your case as a workaround.

Hope this helps. Do let us know if you have any further queries.

If this answers your query, do click `Accept Answer` and `Yes` for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Lakshmi Narayana Sarma Bhamidipati 90 Reputation points

2024-10-28T05:12:58.7666667+00:00

Thanks for the response. apologies for the delayed response.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Lakshmi Narayana Sarma Bhamidipati 90 Reputation points

2024-11-11T03:57:47.0066667+00:00

It is working now after some changes. Thanks

sorry for the delayed response.
Please sign in to rate this answer.
Chandra Boorla 2,990 Reputation points Microsoft Vendor

2024-11-11T09:18:11.33+00:00

@Lakshmi Narayana Sarma Bhamidipati

If you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

getting error while creating mount point in data bricks

2 answers

Your answer