HDInsight Version 3.6 is Deprecated,User SubscriptionId 'XXX' does not have cores left to create resource 'hdi-kafka'. Required: 38, Available: 0.

@blubb - Thanks for the question and using MS Q&A platform.

It seems that you are trying to create an HDInsight cluster using version 3.6, which is deprecated.

Note: The Exercise - Provision HDInsight to perform advanced streaming data transformations using HDInsight cluster using version 3.6, which is deprecated.

To resolve this issue, you can try creating the HDInsight cluster using a different version that is not deprecated.

From Azure portal, you can directly create Azure HDInsight cluster with the version which is available as shown below:

For more details refer to Quickstart: Create Apache Kafka cluster in Azure HDInsight using Azure portal.

Additionally, the error message indicates that your subscription does not have enough cores available to create the 'hdi-kafka' resource.

When creating the Azure HDInsight cluster under Configuration+Pricing page which shows the number of available cores in the region selected as shown below:

In case, if there are no cores available you can Requesting quota increases for Azure HDInsight

You will receive this error when you exceed the limit of cores for a region. You need to raise a support ticket to increase the limit of the number of cores for a East US region.

Cause: Quotas are applied per resource group, subscriptions, accounts, and other scopes. For example, your subscription may be configured to limit the number of cores for a region. If you attempt to deploy a virtual machine with more cores than the permitted amount, you receive an error stating the quota has been exceeded.

Solution: To request a quota increase, go to the portal and file a support issue. In the support issue, request an increase in your quota for the region into which you want to create the VMs.

How to check Usage + Quotas for your subscription?

Select your subscription => Under Settings => Usage + quotas => Use filter to select "HDInsight" & "South India" => Check usage of Total Regional vCPUs => If the usage is full, you need to click on Request Increase to increase the limit of cores in the region.

Reference: Resolve errors for resource quotas

Currently the HDInsight Cluster is not available under the Azure free trial/Student/Pass subscription.

For more details, refer Azure Free Trial - FAQ.

Reason: Azure Free Trail has a limit of 4 cores, and you cannot create HDInsight cluster using a Free Trial Subscription because it requires more than 8 cores.

You need to upgrade to a Pay-As-You-Go subscription to create Azure HDInsight clusters.

Note: Free Trial subscriptions aren't eligible for limit or quota increases. If you have a Free Trial subscription, you can upgrade to a Pay-As-You-Go subscription.

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.