This template creates a V2 data factory that copies data from a folder in an Azure Blob Storage to another folder in the storage.
This Azure Resource Manager (ARM) template was created by a member of the community and not by Microsoft. Each ARM template is licensed to you under a licence agreement by its owner, not Microsoft. Microsoft is not responsible for ARM templates provided and licensed by community members and does not screen for security, compatibility or performance. Community ARM templates are not supported under any Microsoft support programme or service, and are made available AS IS without warranty of any kind.
Parameters
| Parameter Name | Description |
|---|---|
| dataFactoryName | Name of the data factory. Must be globally unique. |
| dataFactoryLocation | Location of the data factory. Currently, only East US and East US 2 are supported. |
| azureStorageConnectionString | Connection string for the Azure Storage account. |
| servicePrincipalId | The ID of the service principal that has permissions to create HDInsight clusters in your subscription. |
| servicePrincipalKey | The access key of the service principal that has permissions to create HDInsight clusters in your subscription. |
Use the template
PowerShell
New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-v2-transform-using-spark/azuredeploy.jsonInstalling and configuring Azure PowerShell
Command line
azure config mode armInstalling and configuring the Azure cross-platform command-line interface
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/101-data-factory-v2-transform-using-spark/azuredeploy.json