Hopp over navigasjon

Azure Quickstart-malene er for øyeblikket tilgjengelige på engelsk

Deploy a Spark cluster in Azure HDInsight

Sist oppdatert: 13.04.2022

This template allows you to create a Spark cluster in Azure HDInsight.

Denne Azure Resource Manager (ARM)-malen ble opprettet av et medlem av fellesskapet og ikke av Microsoft. Hver ARM-mal er lisensiert til deg i henhold til en lisensavtale med eieren, ikke med Microsoft. Microsoft er ikke ansvarlig for ARM-maler som leveres og lisensieres av medlemmer og siler dem ikke ut med tanke på sikkerhet, kompatibilitet eller ytelse. Fellesskapets ARM-maler støttes ikke av noe Microsoft-støtteprogram eller -tjeneste, og er gjort tilgjengelig SOM DE ER, uten noen form for garanti.

Parametere

Parameternavn Beskrivelse
clusterName The name of the HDInsight cluster to create.
clusterLoginUserName These credentials can be used to submit jobs to the cluster and to log into cluster dashboards. The username must consist of digits, upper or lowercase letters, and/or the following special characters: (!#$%&'()-^_`{}~).
clusterLoginPassword The password must be at least 10 characters in length and must contain at least one digit, one upper case letter, one lower case letter, and one non-alphanumeric character except (single-quote, double-quote, backslash, right-bracket, full-stop). Also, the password must not contain 3 consecutive characters from the cluster username or SSH username.
sshUserName These credentials can be used to remotely access the cluster. The sshUserName can only consit of digits, upper or lowercase letters, and/or the following special characters (%&'^_`{}~). Also, it cannot be the same as the cluster login username or a reserved word
sshPassword SSH password must be 6-72 characters long and must contain at least one digit, one upper case letter, and one lower case letter. It must not contain any 3 consecutive characters from the cluster login name
location Location for all resources.
headNodeVirtualMachineSize This is the headnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.
workerNodeVirtualMachineSize This is the workernode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.

Bruke malen

PowerShell

New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deployment
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.hdinsight/hdinsight-spark-linux/azuredeploy.json
Installere og konfigurere Azure PowerShell

Kommandolinje

az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deployment
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.hdinsight/hdinsight-spark-linux/azuredeploy.json
Installer og konfigurer Azures kommandolinjegrensesnitt for alle plattformer