Media and entertainment rendering architecture

This HPC media rendering solution architecture shows Azure CycleCloud monitoring a Pixar Tractor pipeline manager and orchestrating burst compute node capacity on-demand using Azure low-priority Virtual Machines Scale Sets. An Avere vFXT cache makes data from the existing on-premises filesystem and Azure Blob storage available to compute nodes in Azure.

Media and entertainment rendering architectureThis HPC media rendering solution architecture shows Azure CycleCloud monitoring a Pixar Tractor pipeline manager and orchestrating burst compute node capacity on-demand using Azure low-priority Virtual Machines Scale Sets. An Avere vFXT cache makes data from the existing on-premises filesystem and Azure Blob storage available to compute nodes in Azure.123456778

Operations team uses Azure CycleCloud to configure and launch rendering pipeline cluster.

Azure CycleCloud orchestrates virtual machine (VM) creation and software configuration for head nodes, license servers, and Avere vFXT Cache.

Artist submits a render job to the Pixar Tractor pipeline manager.

Azure CycleCloud detects the change in job queue depth and autostarts render farm nodes in Virtual Machines Scale Sets with location, SKU, and configuration customized by job requirements.

Render pipeline manager (head nodes) executes render jobs on the new render farm VMs.

Render jobs pull artifacts from on-premises and Azure Blob storage as needed from NFS-mounted Avere vFXT.

As each job finishes rendering, resulting artifacts are written back to storage through the Avere vFXT.

As job queue empties, Azure CycleCloud auto-stops render farm VMs to reduce cost.

  1. 1 Operations team uses Azure CycleCloud to configure and launch rendering pipeline cluster.
  2. 2 Azure CycleCloud orchestrates virtual machine (VM) creation and software configuration for head nodes, license servers, and Avere vFXT Cache.
  3. 3 Artist submits a render job to the Pixar Tractor pipeline manager.
  4. 4 Azure CycleCloud detects the change in job queue depth and autostarts render farm nodes in Virtual Machines Scale Sets with location, SKU, and configuration customized by job requirements.
  1. 5 Render pipeline manager (head nodes) executes render jobs on the new render farm VMs.
  2. 6 Render jobs pull artifacts from on-premises and Azure Blob storage as needed from NFS-mounted Avere vFXT.
  3. 7 As each job finishes rendering, resulting artifacts are written back to storage through the Avere vFXT.
  4. 8 As job queue empties, Azure CycleCloud auto-stops render farm VMs to reduce cost.

Implementation guidance

Products/Description Documentation

N-Series VMs

N-series virtual machines are ideal for compute and graphics-intensive workloads, helping customers to fuel innovation through scenarios like high-end remote visualization, deep learning, and predictive analytics.

H-Series VMs

The H-series is a new family specifically designed to handle high performance computing workloads such as financial risk modeling, seismic and reservoir simulation, molecular modeling, and genomic research.

Azure CycleCloud

Effectively manage common workloads with ease while creating and optimizing HPC clusters with Microsoft Azure CycleCloud.

Avere vFXT

Faster, more accessible data storage for high-performance computing at the edge

Azure Batch

Cloud-scale job scheduling and compute management