Skip Navigation

Real-time data streams with Apache Kafka and Spark

This action-packed session will show you how to keep up with the ever-increasing stream of data that developers are tasked with processing. From ingestion through real-time stream processing, Alena will teach you how Azure Databricks and HDInsight can keep up with your distributed streaming workflow. You'll learn how to make a fast, flexible, scalable, and resilient data workflow using frameworks like Apache Kafka and Spark Structured Streaming. You'll use these systems to process data from multiple real-time sources, process machine learning tasks, and how to effectively experiment with the real-time streams with real-world examples and code.

Related videos

Leveraging Azure Databricks to minimize time to insight by combining Batch and Stream processing pipelines

The Developer Data Scientist – Creating New Analytics Driven Applications using Apache Spark with Azure Databricks

Machine learning at scale