Centrum videa

Monitor Data Factory pipelines using Azure Monitor and Log Analytics

Gaurav Malhotra joins Scott Hanselman to discuss Azure Data Factory (ADF) integration with Azure Monitor, which enables you to route your data factory metrics to Azure Monitor and Log Analytics. Get the Azure Data Factory Analytics Management Solution service pack from the Azure marketplace.NOTE  Throughout this episode there are multiple references to Operations Management Suite; however, this solution actually uses Azure Monitor and Log Analytics.For more information:Monitor Azure Data Factory with Operations Management Suite (OMS) (docs)Monitor Data Factory pipelines using Operations Management Suite (blog post)Azure Data Factory overviewAzure Data Factory pricingAzure Data Factory documentationAzure Data Factory Management Solution Service Pack (Azure Marketplace)Create a free account (Azure)Follow @SHanselman Follow @AzureFriday Follow @Azure

• Data Factory

Getting started with the Secure DevOps Kit for Azure (AzSK)

Mark Jacobs joins Scott Hanselman to discuss how Microsoft's internal enterprise increases compliance and creates a more trusted cloud environment using the Secure DevOps Kit for Azure (AzSK). Learn how Microsoft's DevOps teams leverage this tool to continuously keep their cloud applications secure and how you can use the same tool to reduce risk in your environment.For more information:Secure DevOps Kit for AzureSecure DevOps Kit for Azure documentationGetting started with the Secure DevOps Kit for AzureCreate a free account (Azure)

Azure Data Factory visual tools now integrated with GitHub

Gaurav Malhotra joins Lara Rubbelke to discuss how you can associate a GitHub repository (public & enterprise) to your Azure Data Factory for collaboration, versioning, source control.For more information, see:Azure Data Factory Visual tools now support GitHub integration (blog post)Visual authoring in Azure Data Factory - Author with GitHub integration (docs)Azure Data Factory overviewAzure Data Factory pricingAzure Data Factory docsCreate a free account (Azure)

• Data Factory

Siphon on HDInsight Kafka

Thomas Alex joins Lara Rubbelke to discuss how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use. Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in near real time. Siphon handles ingestion of over a trillion events per day across multiple business-critical scenarios at Microsoft. In this episode, learn how Siphon uses Apache Kafka for HDInsight as its scalable pub/sub message queue.For more information:Quickstart: Create a Kafka on HDInsight clusterTutorial: Use Spark Structured Streaming with Kafka on HDInsightApache Kafka for HDInsight overviewAzure HDInsight pricingSiphon: Streaming data ingestion with Apache KafkaCreate a free account (Azure)

• Data Factory

CloudEndure joins the Azure Storage Showcase

We welcome DRaaS and Migration Partner CloudEndure to the Azure Storage Showcase!Gonen Stein, Vice President, of CloudEndure walks us through how CloudEndure is helping customers address the challenges of migrating virtual machines to Azure and using Azure as a disaster recovery site. CloudEndure's innovative solution takes the guesswork out of protecting and migrating applications to Azure. Watch this deep dive, listen to our dialogue, and check out the great live demo from Gonen!Learn more at CloudEndure's websiteContact CloudEndure for more information Read more about CloudEndure Try CloudEndure via the Azure Marketplace

• Managed Disks
• Marketplace
• Storage
• Virtual Machines

Provisioning Kubernetes clusters on AKS using HashiCorp Terraform

Anubhav Mishra (Developer Advocate, HashiCorp), joins Scott Hanselman to discuss how to use HashiCorp Terraform to create & manage Kubernetes clusters in Azure using Azure Kubernetes Service (AKS). Mishra further explains the benefits of using Terraform to provision Azure infrastructure and demonstrates how to configure a Kubernetes cluster on AKS.For more information:HashiCorp Terraform overviewGet started with Terraform EnterpriseAzure Kubernetes Service (AKS) with Terraform (GitHub)Azure Kubernetes Service (AKS) overviewCreate a free account (Azure)

• Azure Kubernetes Service (AKS)