Nodes Details in Azure Hbase

Sarvesh Pandey 141 Reputation points
2021-01-27T07:15:15.297+00:00

Which node is better to process 1.5 millions records daily where total size of storage is 10tb.

Its there any way to auto-scale Hbase cluster as there will be only 1 to 2 transaction a day but data size will be large.

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
207 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 85,346 Reputation points Microsoft Employee
    2021-01-27T08:22:02.167+00:00

    Hello @Sarvesh Pandey ,

    This article discusses how to select the right VM size for the various nodes in your HDInsight cluster.

    Azure HDInsight's free Autoscale feature can automatically increase or decrease the number of worker nodes in your cluster based on previously set criteria. The Autoscale feature works by scaling the number of nodes within preset limits based on either performance metrics or a schedule of scale-up and scale-down operations.

    The Autoscale feature uses two types of conditions to trigger scaling events:

    Thresholds for various cluster performance metrics (called load-based scaling):

    Load-based scaling changes the number of nodes in your cluster, within a range that you set, to ensure optimal CPU usage and minimize running cost.

    Time-based triggers (called schedule-based scaling):

    Schedule-based scaling changes the number of nodes in your cluster based on a schedule of scale-up and scale-down operations.

    The following table describes the cluster types and versions that are compatible with the Autoscale feature.

    60872-image.png

    Note: HBase clusters can only be configured for schedule-based scaling, not load-based.

    Reference: Automatically scale Azure HDInsight clusters

    Hope this helps. Do let us know if you any further queries.

    ------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.

0 additional answers

Sort by: Most helpful