nodes are created with anonomous subscription id

superhero112' 1

Hi there,

When I create a hdinsight clusters, the cluster is created with the subscription id that I am in but every time the nodes are forming with different anonymous id and when I try to access the nodes for example zookeeper it is throwing 401 unauthorized error.

I created with the template and also from the portal.

It is happening from the last two days.

Any help

Thank you,
superhero

PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee

2021-02-03T04:53:01.217+00:00
Hello @superhero112' ,

Welcome to the Microsoft Q&A platform.

In order to investigate further, could you please provide the below information:

Which type of HDInsight cluster (Hadoop, Spark, HBase, Storm, Hive LLAP, Kafka, ML Services) are you using?

How you are trying to access the nodes for zookeeper?

Could you please share the screenshot where you find anonymous id for the nodes?
superhero112' 1 Reputation point

2021-02-03T14:26:29.95+00:00

Thanks for response.

I created a spark cluster with3 heads,4 workers, 2 zookeeper nodes.

all these nodes have different subscription id compare to cluster ( my sub id).

whenever I try to get the details like the IP address of those nodes, using

az resource show --ids /subscriptions/656766788****//resourceGroups/rg0-********6c2533cresourcegroup/providers/Microsoft.Compute/virtualMachineScaleSets/zookeepernode/virtualMachines/1/networkInterfaces/zookeepernode-nic/ipConfigurations/zookeepernode-ipconfig

I got an empty response. on the portal If I click on the nodes, it says 401.

But the cluster has the right subscription id, and I can able to see the details.

BR,
Ram
PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee

2021-02-04T10:07:28.797+00:00
Hello @superhero112' ,

Thanks for the details.

If you have created HDInsight cluster without VNET, all the resources will be provisioned in the Microsoft resources group. Hence, it will have different ids.

If you have created HDInsight cluster with VNET, all the resources will be provisioned in the same HDInsight cluster resource group.

Note: The HDInsight cluster is deployed in your resource group, hence it shows your subscription id.

When you say "If I click on the nodes, it says 401.", could you please share the steps and complete error message which you are experiencing?
superhero112' 1 Reputation point

2021-02-04T14:44:11.527+00:00

I deployed the cluster with a Virtual network and subnet (all belong to my sub ID).

until last week the cluster and nodes have the same ids and I have access to nodes to get the information like IP addresses.

az resource show --ids /subscriptions/mysubID/resourceGroups/rg0-*6c2533cresourcegroup/providers/Microsoft.Compute/virtualMachineScaleSets/zookeepernode/virtualMachines/1/networkInterfaces/zookeepernode-nic/ipConfigurations/zookeepernode-ipconfig

shows the IP address.

az resource show --ids /subscriptions/diffrandomID/resourceGroups/rg0-*6c2533cresourcegroup/providers/Microsoft.Compute/virtualMachineScaleSets/zookeepernode/virtualMachines/1/networkInterfaces/zookeepernode-nic/ipConfigurations/zookeepernode-ipconfig

no response

Here is the error when I go to the connected device in the network and click on the nodes :
63949-error.txt
PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee

2021-02-05T07:18:32.84+00:00

Hello @superhero112' ,

This issue looks strange. For a deeper investigation and immediate assistance on this issue, if you have a support plan you may file a support ticket, else please do let us know - so that I will enable a one-time free support request for your subscription.
superhero112' 1 Reputation point

2021-02-05T19:21:45.307+00:00

Yes, we are working with the support team.
PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee

2021-02-08T04:56:36.713+00:00

Hello @superhero112' ,

Thanks for the update.
Could you please share the Support Request number to track internally?
PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee

2021-02-17T03:56:23.693+00:00

Hello @superhero112' ,

Once the issue is sorted out with the support, please do share the resolution, which might be beneficial to other community members reading this thread.

Share via

nodes are created with anonomous subscription id

Your answer