This template allows you to create an HDInsight Spark cluster with schedule-based Autoscale enabled.
This Azure Resource Manager template was created by a member of the community and not by Microsoft. Each Resource Manager template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for Resource Manager templates provided and licensed by community members and does not screen for security, compatibility, or performance. Community Resource Manager templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.
Parameters
| Parameter Name | Description |
|---|---|
| clusterName | The name of the HDInsight cluster to create. |
| clusterLoginUserName | These credentials can be used to submit jobs to the cluster and to log into cluster dashboards. |
| clusterLoginPassword | The password must be at least 10 characters in length and must contain at least one digit, one upper case letter, one lower case letter, and one non-alphanumeric character except (single-quote, double-quote, backslash, right-bracket, full-stop). Also, the password must not contain 3 consecutive characters from the cluster username or SSH username. |
| sshUserName | These credentials can be used to remotely access the cluster. |
| sshPassword | SSH password must be 6-72 characters long and must contain at least one digit, one upper case letter, and one lower case letter. It must not contain any 3 consecutive characters from the cluster login name |
| location | Location for all resources. |
| HeadNodeVirtualMachineSize | This is the headnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value. |
| WorkerNodeVirtualMachineSize | This is the workernode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value. |
Use the template
PowerShell
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstall and configure Azure PowerShell
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.hdinsight/hdinsight-autoscale-schedulebased/azuredeploy.json
Command line
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstall and Configure the Azure Cross-Platform Command-Line Interface
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.hdinsight/hdinsight-autoscale-schedulebased/azuredeploy.json