I love it that so many of you enjoy both our Infrastructure-as-a-service (IaaS) and Platform-as-a-service (PaaS) services. In fact, over 55% of our IaaS customers also benefit from PaaS services. With this deep experience in both PaaS and IaaS, we can take insights from our PaaS services, like the agile benefit of automated management and scale, and apply it to improve our infrastructure services. Today, I am excited to announce one such insight with the general availability of Managed Disks. With this PaaS-like support, you no longer need to be concerned with the complexity of storage management nor worry about storage as you scale. Yet, you still have the full power and control you expect and love with Azure VMs – a “PaaS bridge” on our IaaS VMs.
This not only simplifies the management of every VM created, it is exponentially helpful when deploying at cloud-scale with VM Scale Sets. Azure VM scale sets (VMSS) are a powerful way to reliably deploy massive cloud infrastructure without the overhead of coordinating multiple resources. With Scale sets, you can simplify the management of your applications with automated application scale and load-balancer integration. Today’s announcement extends these platform features to include automated disk management, enabling simpler storage management and even larger scale. With Managed Disks, you can now attach data disks to every instance and create a VM scale set of up to 1,000 VMs, a 10X increase.
These capabilities are just the beginning to bring the agility of PaaS to the comfort of IaaS. I look forward to announcing additional capabilities coming later this year, including OS patching support, application lifecycle integration, application health monitoring, and load-balancer app health integration.
The sections below elaborate on the key benefits of Managed Disks and VM Scale Sets.
Management
Managed Disks free you from storage account scale management. Managed Disks are Azure Resource Manager (ARM) resources, can be fully templatized, and support both Standard and Premium Disk types. You only need to specify the size and type of the disk you want. You can create thousands of Managed Disks without worrying about the storage account and without having to specify any disk details. You can create a blank disk, create one from a VHD in a storage account, or create one from an image as part of VM creation. You can even migrate an existing Azure Resource Manager VM to a VM with managed disks with just a single reboot. You don’t have to worry about reconfiguring your networking or your security rules to start using the powerful new capability.
In addition to the new Managed Disk resource, we also have added Snapshots and Images as Azure Resource Managed resources.
Snapshot and Backup
With today’s launch, you can also take a Disk Snapshot and maintain it as an Azure Resource Manager resource. With snapshots, you can back up your Managed Disks at any point-in-time. These Snapshots exist independent of the source disk and can be used to create new Managed Disks. You can also use the Azure Backup service with Managed Disks to create a backup job with time-based backups, easy VM restoration, and backup retention policies.
Image
Managed Disks also support creating a managed custom Image. You can create an Image from your custom VHD in a storage account or directly from a running VM. This captures in a single Image, all Managed Disks associated with a running Virtual Machine, including both the OS and Data Disks. This even enables deploying a large VM Scale Set with hundreds of VMs using your custom Image, without the need to copy to or manage any storage accounts.
“The new Managed Disks significantly reduces code complexity and simplifies the management of disks. Managed Disks will enable us to expand upon our current database-as-a-service offering on Azure with new MongoDB plan types to help meet the demanding workloads of our users.” – Sean Hyrich, mLab
Creating a VM
Using the Azure PowerShell or AZ CLI, you can easily create a VM with Managed Disks. Below is an example of a CLI command to create a VM with a managed OS disk and a 128 GB managed data disk. You no longer specify a Storage account for either the OS disk or data disk.
$ az vm create -g myResourceGroup -n myLinuxVM --image RHEL --size Standard_DS3_v2 --data-disk-sizes-gb 128
You can also easily create a VM with Managed Disks in the portal by selecting, “Use managed disks:”
Here is an example of creating a Windows VM with Managed OS disk using Azure PowerShell. You will notice that now you don’t specify a Storage account. You can also programmatically create a virtual machine with Managed Disks using Azure Management Libraries for Java and .NET.
Scale
Today, you can now deploy up to 1,000 VMs in a Scale Set based on platform images, a 10x scale improvement. This enables you to deploy and manage a single cluster, like a large-scale Hadoop, DataSynapse, Cassandra, or IIS deployment. Additionally, if you need load balancing at this scale, you can deploy with an Azure Application Gateway for layer-7 load-balancing.
“Elasticsearch, the leading open source data search solution, allows companies to explore anywhere from gigabytes to petabytes of data in real-time. Managed Disks and expanded VM Scale Sets will help Azure users deploy Elasticsearch clusters at very large scale” – Martijn Laarman, Elastic Software Developer
Here is how you can easily create a 1,000 VM scale set:
$ az vmss create -g myResourceGroup -n myVMSSName --image ubuntuLTS --instance-count 1000
Application support for scale sets
VM scale sets now support attached data disks. When you define a scale set you can create as many attached disks as the VM size supports. This allows more data-intensive analytics and search applications to take advantage of the management and scalability benefits of scale sets.
Security
Because Managed Disks, Snapshots, and Images are Azure Resource Manager resources, you can now apply granular access control using Azure RBAC on each. Managed Disks expose a variety of operations such as read, write (create/update), delete, and export. You can now grant access to only the operations that a person needs to perform his/her job. You can even create custom roles and only grant the permissions to best suit your requirements.
You can also encrypt Managed Disks using Azure Disk Encryption with Customer-managed or Microsoft-managed keys.
“Through providing disk as a managed logical resource, Managed Disk brings our customers an enhanced, easy to use and more secure experience. We can now define role-based access controls for the Disks.” – Jesper Jensen, Solvo IT
Migration
Managed Disks comes with easy migration capability from existing unmanaged Azure Resource Manager VMs to Managed Disks VMs without the need to recreate the VM, preserving the configuration and security of that VM. After initiating migration, the VM become available immediately after rebooting. You have full control of the migration and can choose to migrate one VM at a time or plan the migration to be scripted on all of your VMs at once.
You can now also migrate your Managed Disks from Standard to Premium in an easy way. With Managed Disks, if you stop your VM, you can change the account type of your disks without deleting or reconfiguring the VM. The changed disks become available immediately to restart your VM. Here are more details on how to execute the above migration options.
“Performance limits and proper naming to distribute accounts in different stamps need to be considered for a proper design. With Managed Disks, we’ve seen the light, they put to rest all these concerns and let us and our customers concentrate on our business. That’s not all, Managed Disks come with the migration capability, where I can migrate my Virtual Machines to Managed Disks with a single reboot.” –Daniele Grandini, Progel
Pricing
You can visit the Azure Storage Pricing page for more details for Managed Disks. The pricing of Premium Managed Disks is the same as Premium Unmanaged Disks. Standard Managed Disks offer a slightly different pricing model as Standard Unmanaged Disks with pricing based upon the provisioned disk size. Given the change, we are offering a 50% promotional discount on Standard Managed Disks for the first six months.
Availability Regions
As of today, Managed Disks are available in all the global regions. Sovereign clouds will have this support in the coming weeks. Discover the Availability of Managed Disks by regions.
Getting Started
I hope you enjoyed this post and really enjoy this new service offering bringing the agility and ease of PaaS management and scale to your IaaS VMs. Give the service a try! We would love to hear your feedback and comments. Deploying infrastructure has never been so much fun.
See ya around,
Corey