Provisions a Spark Cluster on Ubuntu Virtual Machines

CognosysTech 提供
上次更新时间: 2015/4/6

This template creates a Spark cluster on Ubuntu virtual machine image, enables persistence (by default) and applies all well-known optimizations and best practices

此 Azure Resource Manager (ARM) 模板由社区的某个成员(而不是由 Microsoft)创建。每个 ARM 模板都根据其所有者(不是 Microsoft)的许可协议向你授予许可。Microsoft 不对由社区成员提供并授予许可的 ARM 模板负责,并且不针对安全性、兼容性和性能进行筛选。社区 ARM 模板不由任何 Microsoft 支持计划或服务提供支持,按“原样”提供,没有任何种类的担保。

参数

参数名 说明
adminUsername Administrator user name used when provisioning virtual machines
adminPassword Administrator password used when provisioning virtual machines
imagePublisher Image Publisher
imageOffer Image Offer
imageSKU Image SKU
virtualNetworkName The arbitrary name of the virtual network provisioned for the cluster
addressPrefix The network address space for the virtual network
subnetName Subnet name for the virtual network that resources will be provisioned in to
subnetPrefix Address space for the virtual network subnet
sparkVersion The version of the Spark package to be deployed on the cluster (or use 'stable' to pull in the latest and greatest)
sparkClusterName The arbitrary name of the Spark cluster (maps to cluster's configuration file name)
sparkNodeIPAddressPrefix The IP address prefix that will be used for constructing a static private IP address for each node in the cluster
sparkSlaveNodeIPAddressPrefix The IP address prefix that will be used for constructing a static private IP address for each node in the cluster
jumpbox The flag allowing to enable or disable provisioning of the jumpbox VM that can be used to access the Spark nodes
tshirtSize T-shirt size of the Spark cluster

使用模板

PowerShell
New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/spark-on-ubuntu/azuredeploy.json
安装和配置 Azure PowerShell
命令行
azure config mode arm
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/spark-on-ubuntu/azuredeploy.json
安装和配置 Azure 跨平台命令行界面