Hybrid HPC in Azure with HPC Pack

Azure Virtual Machines
Windows Server

Solution ideas

This article describes a solution idea. Your cloud architect can use this guidance to help visualize the major components for a typical implementation of this architecture. Use this article as a starting point to design a well-architected solution that aligns with your workload's specific requirements.

This article describes how to use Azure HPC Pack to create a hybrid high-performance computing (HPC) environment.

Architecture

Architecture diagram that shows how to use HPC Pack to create a hybrid high-performance computing (HPC) environment.

Download a Visio file of this architecture.

Dataflow

  1. Log in to an on-premises head node.
  2. Add Azure compute nodes to the cluster.
  3. Start the compute nodes.
  4. Submit jobs to the cluster.
  5. HPC Pack sends jobs to on-premises and Azure nodes, based upon the node group selected.
  6. Monitor the job progress.
  7. Stop the compute nodes or configure autoscaling.

Components

  • Virtual Machines: Create Linux and Windows virtual machines in seconds.
  • Microsoft HPC Pack : Free HPC solution built on Microsoft Azure and Windows Server technologies.

Scenario details

Microsoft HPC Pack is a free HPC solution built on Microsoft Azure and Windows Server technologies. HPC Pack combines a comprehensive set of deployment, administration, job scheduling, and monitoring tools for your Windows and Linux HPC cluster environment, providing a flexible platform for developing and running HPC applications on premises and in Azure.

Potential use cases

This solution shows the process for using HPC Pack to create a hybrid (on-premises and Azure) HPC environment.

The following link provides documentation on deploying and managing the Azure products that are included in this solution idea:

Next steps