Create a Data Factory Pipeline with Copy and Hive activities

게시자: Sreedhar Pelluru
마지막 업데이트: 2016-11-17

This template creates a data factory pipeline with Copy and HDInsight Hive activities.

이 ARM(Azure Resource Manager) 템플릿은 Microsoft가 아니라 커뮤니티 구성원에 의해 만들어졌습니다. 각 ARM 템플릿은 Microsoft가 아닌 해당 소유자에 의해 사용이 허가됩니다. Microsoft는 커뮤니티 구성원에 의해 제공 및 라이선스가 부여된 ARM에 대해 책임이 없으며, 보안, 호환성 또는 성능을 검사하지 않습니다. 커뮤니티 ARM 템플릿은 Microsoft 지원 프로그램 또는 서비스에서 지원되지 않고, 어떠한 보증도 없이 있는 그래도 제공됩니다.

매개 변수

매개 변수 이름 설명
storageAccountResourceGroupName The resource group that contains your Azure storage account that contains the input/output data.
storageAccountName Name of the Azure storage account that contains the input/output data.
storageAccountKey Key for the Azure storage account.
blobContainer Name of the blob container in the Azure Storage account.
inputBlobFolder The folder in the blob container that has the input file.
inputBlobName Name of the input file/blob.
ftpHost Name or IP address of FTP server.
ftpUser User account that has access to the FTP server.
ftpPassword Password for the user account that has access to the FTP server.
ftpFolderName The folder in FTP that has the input file.
ftpFileName Name of the input file in FTP.
outputBlobFolder The folder in the blob container that will hold the transformed data.
hiveScriptFolder The folder in the blob container that contains the Hive query file.
hiveScriptFile Name of the hive query (HQL) file.
sqlServerName Name of the Azure SQL Server that will hold the output/copied data.
sqlDatabaseName Name of the Azure SQL Database in the Azure SQL server.
sqlServerUserName Name of the user that has access to the Azure SQL server.
sqlServerPassword Password for the user.
targetSQLTable Table in the Azure SQL Database that will hold the copied data.

템플릿 사용

PowerShell
New-AzureRmResourceGroupDeployment -Name <deployment-name> -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/201-data-factory-ftp-hive-blob/azuredeploy.json
Azure PowerShell 설치 및 구성
명령줄
azure config mode arm
azure group deployment create <my-resource-group> <my-deployment-name> --template-uri https://raw.githubusercontent.com/azure/azure-quickstart-templates/master/201-data-factory-ftp-hive-blob/azuredeploy.json
Azure 크로스 플랫폼 명령줄 인터페이스 설치 및 구성