Create a Data Factory Pipeline with Copy and Hive activities

Sreedhar Pelluru 提供
上次更新日期: 2016/11/17

This template creates a data factory pipeline with Copy and HDInsight Hive activities.

此 Azure Resource Manager (ARM) 範本是由社群成員 (而非 Microsoft) 建立。每個 ARM 範本都是由其擁有者 (而非 Microsoft) 依據授權合約授權給您。Microsoft 並不負責社群成員所提供和授權的 ARM 範本,而不會為了安全性、相容性或效能進行篩選。社群 ARM 範本並未依據任何 Microsoft 支援方案或服務提供支援,而且會在沒有任何擔保的情況下依現況提供。

參數

參數名稱 說明
storageAccountResourceGroupName The resource group that contains your Azure storage account that contains the input/output data.
storageAccountName Name of the Azure storage account that contains the input/output data.
storageAccountKey Key for the Azure storage account.
blobContainer Name of the blob container in the Azure Storage account.
inputBlobFolder The folder in the blob container that has the input file.
inputBlobName Name of the input file/blob.
ftpHost Name or IP address of FTP server.
ftpUser User account that has access to the FTP server.
ftpPassword Password for the user account that has access to the FTP server.
ftpFolderName The folder in FTP that has the input file.
ftpFileName Name of the input file in FTP.
outputBlobFolder The folder in the blob container that will hold the transformed data.
hiveScriptFolder The folder in the blob container that contains the Hive query file.
hiveScriptFile Name of the hive query (HQL) file.
sqlServerName Name of the Azure SQL Server that will hold the output/copied data.
sqlDatabaseName Name of the Azure SQL Database in the Azure SQL server.
sqlServerUserName Name of the user that has access to the Azure SQL server.
sqlServerPassword Password for the user.
targetSQLTable Table in the Azure SQL Database that will hold the copied data.

使用範本

PowerShell

New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/201-data-factory-ftp-hive-blob/azuredeploy.json
安裝和設定 Azure PowerShell

命令列

azure config mode arm
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/201-data-factory-ftp-hive-blob/azuredeploy.json
安裝和設定 Azure 跨平台命令列介面