Before you can have Big Data, you must collect the data. There are two popular ways to do this: with batches and with live streams. Apache Kafka has changed the way we look at streaming and logging data and now Azure provides tools and services for streaming data into your Big Data pipeline in Azure. This session will outline the different services in the Big Data Streaming ecosystem in Azure, how they work together, and when to use which including HDInsight Kafka and Event Hubs. We will also talk briefly about when using traditional ETL tools is a better idea.
AI/ML expert Paige Bailey takes you on a tour of the powerful services available on Azure. You'll see how to take your predictive model to production, dynamically train it online with streaming updates, and add realtime data to your models from IoT sources. Paige covers Azure DataBricks, Batch AI, KubeFlow + AKS, Stream Analytics, and Event Hubs in a session you won't want to miss.
Azure Friday visited various Microsoft booths in the Expo Hall at Build 2018 to learn what's new. In this episode, Lara Rubbelke gets an update on Big Data and Analytics from Shubha Vijayasarathy.For more information, see:Big data and analyticsAzure Event HubsText Classification with SQL ServerCreate a free account (Azure)
The Software Engineers in Microsoft's Devices Supply Chain Engineering have replaced their on-premise B2B integration platform with multiple Azure components all working together to create a fully cloud native scalable messaging infrastructure. In this session, you'll learn how the engineers created an advanced event-driven b2b platform with rich telemetry using multiple Azure services to modernize how messages are passed between parties both internal and external to Microsoft. You'll also learn some lessons from the team on building a complex application across multiple Azure services - API Management, Functions, API Apps, Service Bus, Event Hubs, Key Vault, Application Insights, Log Analytics and Azure Active Directory.