Creating Azure HDInsight process is stuck at "Status: HDInsight Configuration"

Question

Hey,

During the creation of Azure HDinsight (Hadoop Cluster) The process seems to be stuck at

"Status: HDInsight Configuration"

For more than 20 minutes; after it did manage to somewhat create it (note the dashboard itself is up and running), it shows AzureResourceCreationFailedErrorCode.

I've used Azure HDInsight many times before, and this is the first time it happened.

Any ideas? (I've tried redeploy, create new service etc.) - nothing worked.

Any ideas? thanks

Answer 1

Hi @lidorbenshitrit

The issue you're experiencing with the Azure HDInsight creation process being stuck at "Status: HDInsight Configuration" and subsequently showing AzureResourceCreationFailedErrorCode could be due to several common root causes.

Here are some troubleshooting steps you can consider:

Ensure that you haven't exceeded any resource quotas or limits in your Azure subscription, such as the number of cores or the number of HDInsight clusters allowed.

Go to the Activity Log in the Azure portal for your subscription and check for more detailed error messages related to this deployment. Look for any specific error codes or messages in the logs that might point to a misconfiguration or missing dependencies.

Ensure that the user assigned managed identity has the necessary permissions, such as the Storage Blob Data Contributor or Storage Blob Data Owner roles, especially if you are using Azure Data Lake Storage Gen2.

If you have network restrictions, make sure your virtual network or subnet allows proper communication for HDInsight creation. Check if any firewall or NSG (Network Security Group) settings are blocking required communication.

Check if there are any locks on your virtual network or resource group that might be preventing the creation of resources.

Reference documentations:

Troubleshoot cluster creation failures with Azure HDInsight

Azure HDInsight: Cluster creation errors

Hope this helps. Do let us know if you have any further queries.