Azure HDinsight

Ishan Kapoor 1 Reputation point
2022-12-20T11:56:08.33+00:00

What is Resource Provider connection in Azure HDinsight? (In portal, when deploying HDinsight Cluster it gives 2 option first Inbound that has no privatelink tickbox and other is Outbound that has privatelink tickbox). I want to know about both with detailed architecture.

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
204 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. BhargavaGunnam-MSFT 28,616 Reputation points Microsoft Employee
    2022-12-21T22:50:27.833+00:00

    Hello @Ishan Kapoor ,

    Welcome to the MS Q&A platform.

    Inbound and outbound are the general terminologies in Azure across all services. When we say inbound connection- Network traffic is coming into Azure.
    And the Outbound connection is Network traffic going out from the Azure service.

    Resource Provider connection: Direction of network traffic between the HDInsight cluster and the Resource provider.

    Inbound: Inbound is data moving to your Azure service

    Outbound: Outbound is data moving away from your Azure services

    Regarding inbound connection on the HDInsights cluster: You can use advanced controls to create a restricted HDInsight cluster where inbound connectivity is restricted to a private network.

    The default setting is Inbound on the security+networking tab.

    From the below screenshot, you can use Vnet to restrict inbound connectivity via a private network (Vnet is optional in inbound)

    You can filter inbound and outbound network traffic via Network security groups. This document explains the NSGs in HDInsights.

    Control network traffic in Azure HDInsight

    273033-image.png

    Regarding outbound connections:
    If you want public connectivity between your HDInsight cluster and dependent resources, consider restricting the connectivity of your cluster by following the guidelines in Control network traffic in Azure HDInsight.

    When selecting outbound, you can secure outbound traffic from your HDInsight cluster using Vnet. Also, you can enable private endpoint connections.

    This document explains the private endpoint connections in HDInsights.

    You can also configure the outbound traffic via the firewall. Please see this document to Configuring outbound traffic via Azure Firewall with HDInsight

    272958-image.png

    The following diagram shows what a potential HDInsight virtual network architecture might look like when resourceProviderConnection is set to outbound:

    Document: https://video2.skills-academy.com/en-us/azure/hdinsight/hdinsight-restrict-public-connectivity

    Vnet architecture: https://video2.skills-academy.com/en-us/azure/hdinsight/hdinsight-virtual-network-architecture

    273061-image.png

    I hope this helps you understand Azure HD insights' inbound and outbound traffic. In case if you have any further questions, please let me know.

    ------------------------------

    • Please don't forget to click on 130616-image.png and upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators