The Azure Quickstart templates are currently available in English

Performs ETL job using Azure services

게시자: ajos1993
마지막 업데이트: 2020-03-04

This template provides an example of how to perform analytics on the historic as well as real time streaming data stored in Azure Blob Storage. The data from the event hub is taken by the Azure Stream Analytics Job to perform transformation and the output is stored in Azure Blob Storage and is visualized in PowerBI. The analytics is applied on the historic data stored in Blob storage by Azure Data Analytics and the movement of extracted, transformed and published data and the orchestration is done by Data Factory. The published data is further visualized in PowerBI

이 Azure Resource Manager 템플릿은 Microsoft가 아니라 커뮤니티 구성원에 의해 만들어졌습니다. 각 Resource Manager 템플릿은 Microsoft가 아닌 해당 소유자의 사용권 계약에 의거하여 사용이 허가됩니다. Microsoft는 커뮤니티 구성원에 의해 제공 및 라이선스가 부여된 Resource Manager 템플릿에 대해 책임이 없으며, 보안, 호환성 또는 성능을 검사하지 않습니다. 커뮤니티 Resource Manager 템플릿은 Microsoft 지원 프로그램 또는 서비스에서 지원되지 않고, 어떠한 보증도 없이 있는 그대로 제공됩니다.

매개 변수

매개 변수 이름 설명
location The location in which the resources will be created.Check supported locations
eventHubNamespaceName Name of the EventHub namespace
captureTime the time window in seconds for the archival
captureSize the size window in bytes for event hub capture
eventhubSku The messaging tier for service Bus namespace
skuCapacity MessagingUnits for premium namespace
isAutoInflateEnabled Enable or disable AutoInflate
messageRetentionInDays How long to retain the data in Event Hub
partitionCount Number of partitions chosen
captureEncodingFormat The encoding format Eventhub capture serializes the EventData when archiving to your storage
adlAnalyticsName The name of the Data Lake Analytics account to create.
adlStoreName The name of the Data Lake Store account to create.
vmSize Size of vm Eg. Standard_D1_v2
vm_username Username for the Virtual Machine.
vm_password Password for the Virtual Machine.
OptionalWizardInstall Select whether the VM should be in production or not.
dataFactoryName Name of the data factory. Must be globally unique.
appName Name of the Azure datalake UI app registered. Must be globally unique.
servicePrincipalId The ID of the service principal that has permissions to create HDInsight clusters in your subscription.
servicePrincipalKey The access key of the service principal that has permissions to create HDInsight clusters in your subscription.
dataLakeAnalyticsLocation The location in which the resources will be created.Check supported locations
_artifactsLocation The base URI where artifacts required by this template are located here
_artifactsLocationSasToken The sasToken required to access _artifactsLocation. When the template is deployed using the accompanying scripts, a sasToken will be automatically generated. Use the defaultValue if the staging location is not secured.

템플릿 사용

PowerShell

New-AzResourceGroup -Name <resource-group-name> -Location <resource-group-location> #use this command when you need to create a new resource group for your deployment
New-AzResourceGroupDeployment -ResourceGroupName <resource-group-name> -TemplateUri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/yash-datalake/azuredeploy.json
Azure PowerShell 설치 및 구성

명령줄

az group create --name <resource-group-name> --location <resource-group-location> #use this command when you need to create a new resource group for your deployment
az group deployment create --resource-group <my-resource-group> --template-uri https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master/yash-datalake/azuredeploy.json
Azure 크로스 플랫폼 명령줄 인터페이스 설치 및 구성