This template creates a data factory pipeline with a HDInsight Hive activity.
This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.
Parameters
| Parameter Name | Description |
|---|---|
| storageAccountResourceGroupName | The resource group that contains your Azure storage account that contains the input/output data. |
| storageAccountName | Name of the Azure storage account that contains the input/output data. |
| storageAccountKey | Key for the Azure storage account. |
| blobContainer | Name of the blob container in the Azure Storage account. |
| inputBlobFolder | The folder in the blob container that has the input file. |
| inputBlobName | Name of the input file/blob. |
| outputBlobFolder | The folder in the blob container that will hold the transformed data. |
| hiveScriptFolder | The folder in the blob container that contains the Hive query file. |
| hiveScriptFile | Name of the hive query (HQL) file. |
| location | Location for all resources. |
Use the template
PowerShell
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring Azure PowerShell
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-hive-transformation/azuredeploy.json
Command line
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring the Azure cross-platform command-line interface
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-hive-transformation/azuredeploy.json