Azure Databricks Compute Instance Quota Issue

Dmitriy Khodyrev 20

Знімок екрана 2024-10-30 193040

Unable to create a compute instance in Azure Databricks due to a quota issue. The error message received is:

This account may not have enough CPU cores to start a cluster. Contact your administrator to increase the limits.

Additionally, it is noted that the account should have Free DBUs as part of the Trial (Premium - 14-Days Free DBUs).

Amira Bedhiafi 26,491 Reputation points

2024-10-31T10:50:41.31+00:00

As the error states, you already reached the CPU core quota limit in your Azure subscription, which prevents you from creating new compute instances in Azure Databricks.

In the Azure portal, navigate to Subscriptions > select your subscription > Usage + quotas. Look for the vCPUs (virtual CPU cores) under the Compute category.

In the same Usage + quotas section, select Request increase for the relevant region where you want to deploy your Databricks compute instance. Fill out the necessary information to request additional vCPU cores.

Confirm the 14-day trial DBUs are active by going to Azure Databricks > Workspace > Manage Account > Usage. Ensure your subscription includes these DBUs, as they should cover the Databricks units (DBUs) required for the cluster.

If you’re unable to increase quotas or if there are inconsistencies with the free DBUs, contacting Azure support can clarify any account or trial restrictions.
Smaran Thoomu 16,890 Reputation points Microsoft Vendor

2024-11-01T07:07:07.9533333+00:00

@Dmitriy Khodyrev Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Dmitriy Khodyrev 20 Reputation points

2024-11-01T10:58:16.2633333+00:00

Thanks for your comment,

I've checked the quotas, but I didn't spend any of it, and also I could find databricks kind of instances within available quotas

Also my trial (Trial (Premium - 14-Days Free DBUs) (Click to change)) still has 14 days, so I couldn't spend it yet
PRADEEPCHEEKATLA 90,231 Reputation points

2024-11-06T13:24:25.75+00:00

Dmitriy Khodyrev - Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Accepted answer

PRADEEPCHEEKATLA 90,231 Reputation points

2024-10-31T12:08:31.4+00:00

@Dmitriy Khodyrev - Thanks for the question and using MS Q&A platform.

This is not the error message and it's just a warning message.

I agree that it looks like an error message but it's a warning message to indicates that the : This account may not have enough CPU cores to start the cluster. Contact your administrator to increase the limits.

As per the repro from my end, I had tried to create a cluster with single node which consumes 4 cores and able to successfully create the cluster without any issue.

Even this is not the error message and it's just a warning message.

I agree that it looks like an error message but it's a warning message to indicates that the : This account may not have enough CPU cores to start the cluster. Contact your administrator to increase the limits.

Hope this helps. Do let us know if you have any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Dmitriy Khodyrev 20 Reputation points

2024-11-01T10:56:40.9266667+00:00

Thanks for suggestion, but it my case this actually block me from creation of compute instance, not just warns

Naagesh R Aswartha 0 Reputation points

2024-11-02T06:48:27.9433333+00:00

Not working

Smaran Thoomu 16,890 Reputation points Microsoft Vendor

2024-11-04T15:17:27.67+00:00

Dmitriy Khodyrev & Naagesh R Aswartha - Could you please try to create in another region and let us know?

Smaran Thoomu 16,890 Reputation points Microsoft Vendor

2024-11-05T14:10:46.3433333+00:00

Dmitriy Khodyrev & Naagesh R Aswartha - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure Databricks Compute Instance Quota Issue

0 additional answers

Your answer