Facing challenges with Azure databricks cluster spin up

Question

We have opened the firewalls to west us IP addresses and domains for Azure Databricks services and assets - Azure Databricks | Microsoft Learn but still we are not able to spin the cluster the cluster spin up fails with ailure message: Bootstrap script took too long and timeout.

Can you please share the urls for which firewalls have to be opened to solve this issue

Answer 1

Hi @Rashmi Sunkeneni

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

the cluster spin up fails with ailure message: Bootstrap script took too long and timeout.

To resolve the issue with the Azure Databricks cluster spin-up failing due to a bootstrap script timeout, you need to ensure that the necessary firewall rules are configured correctly. Specifically, you should allow outbound traffic to the required Azure Databricks domains and IP addresses.

For Azure Databricks, it is recommended to use the Azure Databricks service tag instead of specific IP addresses. This service tag encompasses the necessary IP address prefixes for outbound connections to the Azure Databricks control plane, secure cluster connectivity, and the Azure Databricks web application. This helps in preventing service outages due to IP changes.

If you are using User-Defined Routes (UDR), ensure that the routing is correctly set up to allow outbound connections to the required IP addresses for the region where your cluster is deployed.

For additional information, please refer the following documentations:

User-defined route settings for Azure Databricks

Configure domain name firewall rules

I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Thank you.