HDInsight (Linux on existing Hive metastore, SSH, vnet)

Last updated: 20/11/2015

This template allows you to create an HDInsight cluster running Linux, on an existing Hive metastore and virtual network. The SSH authentication method for the cluster is username / password.

This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.

Parameters

Parameter Name Description
clusterName The name of the cluster to create.
clusterVersion The HDInsight version to deploy.
headNodeSize The VM size of the head nodes.
workerNodeSize The VM size of the worker nodes.
workerNodeCount The number of worker nodes in the cluster.
clusterLoginUserName These credentials can be used to submit jobs to the cluster and to log into cluster dashboards.
clusterLoginPassword The password must be at least 10 characters in length and must contain at least one digit, one non-alphanumeric character, and one upper or lower case letter.
sshUserName These credentials can be used to remotely access the cluster.
sshPassword The password must be at least 10 characters in length and must contain at least one digit, one non-alphanumeric character, and one upper or lower case letter.
existingClusterStorageResourceGroup The resource group name of the storage account to use as the cluster's default storage.
existingClusterStorageAccountName The name of the storage account to use as the cluster's default storage.
newOrExistingClusterStorageContainerName The name of the storage container to use.
existingHiveMetastoreServerName The fully-qualified domain name of the SQL server to use for the external Hive metastore.
existingHiveMetastoreDatabaseName The external Hive metastore's existing SQL database.
existingHiveMetastoreUsername The external Hive metastore's existing SQL server admin username.
existingHiveMetastorePassword The external Hive metastore's existing SQL server admin password.
existingVirtualNetworkResourceGroup The existing virtual network resource group name.
existingVirtualNetworkName The existing virtual network name.
existingVirtualNetworkSubnetName The existing virtual network subnet name.

Use the template

PowerShell

New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/101-hdinsight-linux-ssh-publickey-metastore-vnet/azuredeploy.json
Installing and configuring Azure PowerShell

Command line

azure config mode arm
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/101-hdinsight-linux-ssh-publickey-metastore-vnet/azuredeploy.json
Installing and configuring the Azure cross-platform command-line interface