Create a Data Factory, Copy from Blob to SQL with Sproc

Last updated: 10/10/2016

This template creates a data factory pipeline for a copy activity from Azure Blob into an Azure SQL Database while invoking a stored procedure

This Azure Resource Manager template was created by a member of the community and not by Microsoft. Each Resource Manager template is licensed to you under a license agreement by its owner, not Microsoft. Microsoft is not responsible for Resource Manager templates provided and licensed by community members and does not screen for security, compatibility, or performance. Community Resource Manager templates are not supported under any Microsoft support program or service, and are made available AS IS without warranty of any kind.

Parameters

Parameter Name Description
storageAccountName Name of the Azure storage account that contains the data to be copied.
storageAccountKey Key for the Azure storage account.
sourceBlobContainer Name of the blob container in the Azure Storage account.
sourceBlobName Name of the blob in the container that has the data to be copied to Azure SQL Database table
sqlServerName Name of the Azure SQL Server that will hold the output/copied data.
sqlDatabaseName Name of Azure SQL Database in Azure SQL server copying data to.
sqlUserID Username for access to Azure SQL Server.
sqlPassword Password for the user to Azure SQL Server.
sqlTargetTable Table in the Azure SQL Database that will hold the copied data.
sqlWriterTableType Specify a table type name to be used in the stored procedure. Copy activity makes the data being moved available in a temp table with this table type.
sqlWriterStoredProcedureName Name of the stored procedure that upserts (updates/inserts) data into the target table.

Use the template

PowerShell
New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/101-data-factory-blob-to-sql-copy-stored-proc/azuredeploy.json
Install and configure Azure PowerShell
Command line
azure config mode arm
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/101-data-factory-blob-to-sql-copy-stored-proc/azuredeploy.json
Install and Configure the Azure Cross-Platform Command-Line Interface