The Azure Quickstart templates are currently available in English
Create a Data Factory Pipeline with Copy and Hive activities
This template creates a data factory pipeline with Copy and HDInsight Hive activities.
Ce modèle ARM (Azure Resource Manager) a été créé par un membre de la communauté et non par Microsoft. Chaque modèle ARM vous est concédé sous licence sous un contrat de licence par son propriétaire, et non par Microsoft. Microsoft ne peut pas être tenu responsable des modèles ARM fournis et concédés sous licence par les membres de la communauté, ni ne vérifie leur sécurité, leur compatibilité ou leurs performances. Les modèles ARM de la communauté ne sont pris en charge par aucun programme ou service de support Microsoft. Ils sont rendus disponibles EN L'ÉTAT sans garantie d'aucune sorte.
Paramètres
| Nom du paramètre | Description |
|---|---|
| storageAccountResourceGroupName | The resource group that contains your Azure storage account that contains the input/output data. |
| storageAccountName | Name of the Azure storage account that contains the input/output data. |
| storageAccountKey | Key for the Azure storage account. |
| blobContainer | Name of the blob container in the Azure Storage account. |
| inputBlobFolder | The folder in the blob container that has the input file. |
| inputBlobName | Name of the input file/blob. |
| ftpHost | Name or IP address of FTP server. |
| ftpUser | User account that has access to the FTP server. |
| ftpPassword | Password for the user account that has access to the FTP server. |
| ftpFolderName | The folder in FTP that has the input file. |
| ftpFileName | Name of the input file in FTP. |
| outputBlobFolder | The folder in the blob container that will hold the transformed data. |
| hiveScriptFolder | The folder in the blob container that contains the Hive query file. |
| hiveScriptFile | Name of the hive query (HQL) file. |
| sqlServerName | Name of the Azure SQL Server that will hold the output/copied data. |
| sqlDatabaseName | Name of the Azure SQL Database in the Azure SQL server. |
| sqlServerUserName | Name of the user that has access to the Azure SQL server. |
| sqlServerPassword | Password for the user. |
| targetSQLTable | Table in the Azure SQL Database that will hold the copied data. |
Utiliser le modèle
PowerShell
New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstaller et configurer Azure PowerShell
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.databricks/data-factory-ftp-hive-blob/azuredeploy.json
Ligne de commande
az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deploymentInstaller et configurer l'interface de ligne de commande multiplateforme Azure
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/quickstarts/microsoft.databricks/data-factory-ftp-hive-blob/azuredeploy.json