Unable to create compute in Databricks with Azure Free Trial even after several trials.

Question

Hello Team,

I have taken up azure free trial on the sole purpose to learn Databricks. Right after creating the account, I went up straight to launch databricks workspace and tried creating a cluster but was unsuccessful. I have went through most of the similar threads but ended up failing to solve it.

Error : Azure Quota Exceeded Exception: Hitting Azure quota limits: Error code: QuotaExceeded, error message: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource Manager, Location: eastus, Current Limit: 4, Current Usage: 4, Additional Required: 4, (Minimum) New Limit Required: 8. Setup Alerts when Quota reaches threshold.

Can you please help me out in this regard. Thankyou

Answer 1

Hi @kkv_manikanta

Thanks for the question and using MS Q&A platform.

This is execpted behaviour when you are trying to use more CPU cores which are not available in your subscription (Azure free trial/Student/Pass).

Reason: Azure free trial/Student/Pass subscription has a limit of 4 cores, and you cannot create Databricks cluster multi node using a Student Subscription because it requires more than 8 cores.

You need to upgrade to a Pay-As-You-Go subscription to create Azure Databricks clusters with multi mode.

Note: Azure free trial/Student/Pass subscriptions aren't eligible for limit or quota increases. If you have a Student subscription, you can upgrade to a Pay-As-You-Go subscription.

You can use Azure Free Trial subscription to create a Single node cluster which will have one Driver node with 4 cores.

A Single Node cluster is a cluster consisting of a Spark driver and no Spark workers. Such clusters support Spark jobs and all Spark data sources, including Delta Lake. In contrast, Standard clusters require at least one Spark worker to run Spark jobs.

Single Node clusters are helpful in the following situations:

• Running single node machine learning workloads that need Spark to load and save data
• Lightweight exploratory data analysis (EDA)

Reference: Azure Databricks - Single Node clusters

To use multi-node cluster in Azure Databricks, you need to have “Pay-As-You-Go” subscription.

Why can't I use Azure Free Trial subscription?

Azure Free Trial has a limit of 4 cores, and you cannot create Azure Databricks cluster using a Free Trial Subscription because to create a spark cluster which requires more than 4 cores i.e (Minimum 4 cores for Driver type and 4 cores for Worker type).

For more details, refer to Quickstart: Run a Spark job on Azure Databricks Workspace using the Azure portal

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.