Programmatic way to perform tasks on Azure HDinsight

Akash Verma 26 Reputation points
2020-10-07T09:20:05.27+00:00

Can someone please give reference to perform below tasks on Azure HDinsight via programmatic way:

Enable diagnostics setting on HDinsights Cluster
Enable Azure Monitor for the HDInsight cluster
Enable NSG Flow Logs
NSG Modifications (Rule Add, delete, update etc)

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
210 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. PRADEEPCHEEKATLA-MSFT 89,466 Reputation points Microsoft Employee
    2020-10-07T12:54:18.643+00:00

    Hello @Akash Verma ,

    You can use Azure CLI, Azure PowerShell, ARM, and REST API to configure programmatic way.

    Enable diagnostics setting on HDInsight Cluster

    This article provides details on creating and configuring diagnostic settings to send platform metrics and platform logs to different destinations using Azure Portal, Azure PowerShell, ARM template, REST API and Azure policy.

    Enable Azure Monitor for the HDInsight cluster

    This article helps on how to enable Azure Monitor logs to monitor Hadoop cluster operations in HDInsight using Azure Portal, Azure PowerShell & Azure CLI.

    Enable NSG Flow Logs

    This article helps to enable NSG Flow logs using Azure Portal, PowerShell, CLI, REST and ARM Template to enable NSG Flow logs:

    NSG Modifications (Rule Add, delete, update etc)

    For HDInsight: This article provides examples and code samples for creating and configuring Azure Virtual Networks. To use with Azure HDInsight clusters. Detailed examples of creating network security groups (NSGs) and configuring DNS are presented.

    In General: This article to helps to create, change, or delete a network security group via Azure Portal, PowerShell and Azure CLI.

    Hope this helps. Do let us know if you any further queries.

    ----------------------------------------------------------------------------------------

    Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.