Hybrid HPC in Azure with HPC Pack

Azure Virtual Machines
Windows Server

Solution ideas

This article is a solution idea. If you'd like us to expand the content with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know by providing GitHub feedback.

This article describes how to use Azure HPC Pack to create a hybrid high-performance computing (HPC) environment.

Architecture

Architecture diagram that shows how to use HPC Pack to create a hybrid high-performance computing (HPC) environment.

Download a Visio file of this architecture.

Dataflow

  1. Log in to an on-premises head node.
  2. Add Azure compute nodes to the cluster.
  3. Start the compute nodes.
  4. Submit jobs to the cluster.
  5. HPC Pack sends jobs to on-premises and Azure nodes, based upon the node group selected.
  6. Monitor the job progress.
  7. Stop the compute nodes or configure autoscaling.

Components

  • Virtual Machines: Create Linux and Windows virtual machines in seconds.
  • Microsoft HPC Pack : Free HPC solution built on Microsoft Azure and Windows Server technologies.

Scenario details

Microsoft HPC Pack is a free HPC solution built on Microsoft Azure and Windows Server technologies. HPC Pack combines a comprehensive set of deployment, administration, job scheduling, and monitoring tools for your Windows and Linux HPC cluster environment, providing a flexible platform for developing and running HPC applications on premises and in Azure.

Potential use cases

This solution shows the process for using HPC Pack to create a hybrid (on-premises and Azure) HPC environment.

The following link provides documentation on deploying and managing the Azure products that are included in this solution idea:

Next steps