Deploy HDInsight cluster + Confluent Schema Registry node

Last updated: 18-08-2020

This template allows you to create an HDInsight cluster running Linux with a schema registry edge node. For more information, see https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apps-use-edge-node

This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service and are made available AS IS without warranty of any kind.

Parameters

Parameter Name Description
clusterName The name of the Kafka cluster to create. This must be a unique name.
clusterLoginUserName Cluster Login Name
clusterLoginPassword The password must be at least 10 characters in length and must contain at least one digit, one upper case letter, one lower case letter, and one non-alphanumeric character except (single-quote, double-quote, backslash, right-bracket, full-stop). Also, the password must not contain 3 consecutive characters from the cluster username or SSH username.
sshUserName These credentials can be used to remotely access the cluster.
sshPassword SSH password must be 6-72 characters long and must contain at least one digit, one upper case letter, and one lower case letter. It must not contain any 3 consecutive characters from the cluster login name.
_artifactsLocation The base URI where artifacts required by this template are located.
_artifactsLocationSasToken The sasToken required to access _artifactsLocation. When the template is deployed using the accompanying scripts, a sasToken will be automatically generated. Use the defaultValue if the staging location is not secured.
installScriptActionFolder A script action you can run on the empty node to install or configure additional software.
installScriptAction A script action you can run on the empty node to install or configure additional software.
location Location for all resources.
HeadNodeVirtualMachineSize This is the headnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.
WorkerNodeVirtualMachineSize This is the worerdnode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.
ZookeeperNodeVirtualMachineSize This is the Zookeepernode Azure Virtual Machine size, and will affect the cost. If you don't know, just leave the default value.

Use the template

PowerShell

New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deployment
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-hdinsight-kafka-with-edge-schema-registry/azuredeploy.json
Install and configure Azure PowerShell

Command line

az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deployment
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-hdinsight-kafka-with-edge-schema-registry/azuredeploy.json
Install and Configure the Azure Cross-Platform Command-Line Interface