The Azure Quickstart templates are currently available in English
Create a Data Factory Pipeline with Copy and Hive activities
This template creates a data factory pipeline with Copy and HDInsight Hive activities.
Deze ARM-sjabloon (Azure Resource Manager) is gemaakt door een lid van de community, niet door Microsoft. Elke ARM-sjabloon wordt aan u in licentie gegeven onder een licentieovereenkomst van de eigenaar, niet van Microsoft. Microsoft is niet verantwoordelijk voor ARM-sjablonen die door communityleden worden verstrekt en in licentie worden gegeven, en test deze sjablonen ook niet op veiligheid, compatibiliteit of prestaties. ARM-sjablonen van de community worden onder geen enkel programma of geen enkele service van Microsoft ondersteund, en worden 'AS IS' beschikbaar gesteld, zonder enige vorm van garantie.
Parameters
| Parameternaam | Beschrijving |
|---|---|
| storageAccountResourceGroupName | The resource group that contains your Azure storage account that contains the input/output data. |
| storageAccountName | Name of the Azure storage account that contains the input/output data. |
| storageAccountKey | Key for the Azure storage account. |
| blobContainer | Name of the blob container in the Azure Storage account. |
| inputBlobFolder | The folder in the blob container that has the input file. |
| inputBlobName | Name of the input file/blob. |
| ftpHost | Name or IP address of FTP server. |
| ftpUser | User account that has access to the FTP server. |
| ftpPassword | Password for the user account that has access to the FTP server. |
| ftpFolderName | The folder in FTP that has the input file. |
| ftpFileName | Name of the input file in FTP. |
| outputBlobFolder | The folder in the blob container that will hold the transformed data. |
| hiveScriptFolder | The folder in the blob container that contains the Hive query file. |
| hiveScriptFile | Name of the hive query (HQL) file. |
| sqlServerName | Name of the Azure SQL Server that will hold the output/copied data. |
| sqlDatabaseName | Name of the Azure SQL Database in the Azure SQL server. |
| sqlServerUserName | Name of the user that has access to the Azure SQL server. |
| sqlServerPassword | Password for the user. |
| targetSQLTable | Table in the Azure SQL Database that will hold the copied data. |
De sjabloon gebruiken
PowerShell
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentAzure PowerShell installeren en configureren
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.databricks/data-factory-ftp-hive-blob/azuredeploy.json
Opdrachtregel
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentDe platformoverschrijdende Azure-opdrachregelinterface installeren en configureren
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.databricks/data-factory-ftp-hive-blob/azuredeploy.json