Solution architecture: Big compute solutions as a service

High-performance computing (HPC) applications can scale to thousands of compute cores, extend on-premises big compute or run as a 100% cloud-native solution. This HPC solution is implemented with Azure Batch, which provides job scheduling, auto-scaling of compute resources and execution management of platforms as a service (PaaS) that reduces HPC infrastructure code and maintenance.

This solution is built on the Azure-managed services: Virtual Machines, Storage and Batch. These services run in a high-availability environment that is patched and supported, allowing you to focus on your solution instead of the environment they run in.

Pool Storage Virtual Machines Client App Web App Batch

Implementation guidance

Products/Description Documentation

Virtual Machines

Size A8/A9 Azure virtual machines provide HPC compute nodes running on Windows or Linux operating systems.
RDMA networking, available with A8 and A9 instances, is used to achieve high bandwidth and microsecond latencies between compute nodes.
Storage nodes can also be run within virtual machines.

Storage

Azure Storage blobs store the disks that back the virtual machines and provide long-term storage of unstructured data and executable files used by the HPC application.

Batch

Azure Batch sends large amounts of data to the compute engine running in the cloud.

Related solution architectures

OR Availability Set ARM template Script file ClusterHead Node Virtual Machines VM Scale Set RDMA Network A8, A9, and H SeriesVirtual Machines Storage Virtual Network

HPC cluster deployed in the cloud

High-performance computing (HPC) applications can scale to thousands of compute cores, extend on-premises big compute or run as a 100% cloud-native solution. This HPC solution, including the head node, compute nodes and storage nodes, runs in Azure with no hardware infrastructure to maintain.

Learn more
HPC Compute Cluster OR OR VM Scale Set Virtual Machines Virtual Network Azure On-Premise S torage VPN Express R oute Cluster Nodes Cluster Head Node

On-premises HPC implementation bursting to Azure

High-performance computing (HPC) applications can scale to thousands of compute cores, extend on-premises big compute or run as a 100% cloud-native solution. This HPC solution can extend its computational capacity by leveraging the compute-intensive instances of Virtual Machines running in Azure and accessed via Express Route or a VPN.

Learn more