This template creates a V2 data factory that copies data from a folder in an Azure Blob Storage to another folder in the storage.
This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.
Parameters
| Parameter Name | Description |
|---|---|
| dataFactoryName | Name of the data factory. Must be globally unique. |
| dataFactoryLocation | Location of the data factory. Currently, only East US and East US 2 are supported. |
| azureStorageConnectionString | Connection string for the Azure Storage account. |
| servicePrincipalId | The ID of the service principal that has permissions to create HDInsight clusters in your subscription. |
| servicePrincipalKey | The access key of the service principal that has permissions to create HDInsight clusters in your subscription. |
Use the template
PowerShell
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring Azure PowerShell
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-v2-transform-using-spark/azuredeploy.json
Command line
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstalling and configuring the Azure cross-platform command-line interface
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-v2-transform-using-spark/azuredeploy.json