This template allows you to create a Spark cluster in Azure HDInsight.
This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.
|clusterName||The name of the HDInsight cluster to create.|
|clusterLoginUserName||These credentials can be used to submit jobs to the cluster and to log into cluster dashboards.|
|clusterLoginPassword||The password must be at least 10 characters in length and must contain at least one digit, one upper case letter, one lower case letter, and one non-alphanumeric character except (single-quote, double-quote, backslash, right-bracket, full-stop). Also, the password must not contain 3 consecutive characters from the cluster username or SSH username.|
|sshUserName||These credentials can be used to remotely access the cluster.|
|sshPassword||SSH password must be 6-72 characters long and must contain at least one digit, one upper case letter, and one lower case letter. It must not contain any 3 consecutive characters from the cluster login name|
|location||Location for all resources.|
|HeadNodeVirtualMachineSize||This is the headnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.|
|WorkerNodeVirtualMachineSize||This is the worerdnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.|
Use the template
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring Azure PowerShell
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-hdinsight-spark-linux/azuredeploy.json
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring the Azure cross-platform command-line interface
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-hdinsight-spark-linux/azuredeploy.json