HDInsight Version 3.6 is Deprecated,User SubscriptionId 'XXX' does not have cores left to create resource 'hdi-kafka'. Required: 38, Available: 0.

Question

I am going through this tutorial and getting this error when trying to create a HDInsight cluster:

HDInsight Version 3.6 is Deprecated,User SubscriptionId 'XXX' does not have cores left to create resource 'hdi-kafka'. Required: 38, Available: 0.

This post wasn't helpful.

How can I proceed?

Answer 1

@blubb - Thanks for the question and using MS Q&A platform.

It seems that you are trying to create an HDInsight cluster using version 3.6, which is deprecated.

Note: The Exercise - Provision HDInsight to perform advanced streaming data transformations using HDInsight cluster using version 3.6, which is deprecated.

To resolve this issue, you can try creating the HDInsight cluster using a different version that is not deprecated.

From Azure portal, you can directly create Azure HDInsight cluster with the version which is available as shown below:

For more details refer to Quickstart: Create Apache Kafka cluster in Azure HDInsight using Azure portal.

Additionally, the error message indicates that your subscription does not have enough cores available to create the 'hdi-kafka' resource.

When creating the Azure HDInsight cluster under Configuration+Pricing page which shows the number of available cores in the region selected as shown below:

In case, if there are no cores available you can Requesting quota increases for Azure HDInsight

You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a East US region.

Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

How to check Usage + Quotas for your subscription?

Select your subscription => Under Settings => Usage + quotas => Use filter to select "HDInsight" & "South India" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

Reference: Resolve errors for resource quotas

Currently the HDInsight Cluster is not available under the Azure free trial/Student/Pass subscription.

For more details, refer Azure Free Trial - FAQ.

Reason: Azure Free Trail has a limit of 4 cores, and you cannot create HDInsight cluster using a Free Trial Subscription because it requires more than 8 cores.

You need to upgrade to a Pay-As-You-Go subscription to create Azure HDInsight clusters.

Note: Free Trial subscriptions aren't eligible for limit or quota increases. If you have a Free Trial subscription, you can upgrade to a Pay-As-You-Go subscription.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.