Azure Code Samples

Use Spark Structured Streaming with Apache Spark and Kafka on HDInsight

How to read data from Apache Kafka on HDInsight using Spark Structured Streaming.

HDInsight

by Larry Franks,
Last updated: 6/19/2017

Read and write from EventHubs using a hybrid .NET/Java Storm topology

An example of using a hybrid dotnet/Java-based Apache Storm topology to work with Azure Event Hubs

by Larry Franks,
Last updated: 5/23/2017

hdinsight-java-hive-jdbc

An example of how to use the JDBC to issue Hive queries from a Java client application.

by Larry Franks,
Last updated: 5/22/2017

hdinsight-python-storm-wordcount

How to use Python components in an Apache Storm topology on HDInsight

by Larry Franks,
Last updated: 4/5/2017

hdinsight-java-storm-eventhub

A basic example of how to read and write data to Azure Event Hubs from an Apache Storm topology running on HDInsight.

by Larry Franks,
Last updated: 4/3/2017

Java-based word count topology

A basic example of a Java-based Apache Storm Topology, and how to deploy and run it with HDInsight.

by Larry Franks,
Last updated: 3/29/2017

hdinsight-dotnet-storm-powerbi

How to use PowerBI to display information generated by a Apache Storm topology running on HDInsight

by Larry Franks,
Last updated: 10/25/2016

Use Apache Kafka with Apache Storm on HDInsight

Java-based example of reading and writing to Apache Kafka from Apache Storm on HDInsight

by Larry Franks,
Last updated: 2/10/2017

hdinsight-dotnet-storm-wordcount

A basic example of a dotnet-based Apache Storm topology and how to run it on HDInsight.

by Larry Franks,
Last updated: 10/25/2016

hdinsight-storm-azure-data-lake-store

Learn how to write data to Azure Data Lake Store from a Java-based Apache Storm topology using HDInsight.

by Larry Franks,
Last updated: 3/3/2017

Event correlation with Apache Storm and HBase

How to correlate events that arrive at different times by using a unique identifier and storing event state.

by Larry Franks,
Last updated: 6/22/2016

MyDriving - An Azure IOT and Mobile Sample Application

Building IoT or Mobile solutions are fun and exciting. This year for Build, we wanted to show the amazing scenarios that can come together when these two are combined. So, we went and developed a sample application. MyDriving uses a wide range of Azure services to process and analyze car telemetry data for both real-time insights and long-term patterns and trends. The following features are supported in the current version of the mobile app.

by Alina Popa,
Last updated: 3/16/2017

hdinsight-dotnet-python-azure-storage-shared-access-signature

How to restrict access to Azure blob storage from HDInsight by using shared access signatures. This sample spans HDInsight and Azure Storage, and samples are provided for dotnet and python.

by Larry Franks,
Last updated: 8/9/2016

Programmatically deploy a topology to Apache Storm on HDInsight

An example of how to programmatically deploy a Storm topology to an HDInsight cluster.

by Larry Franks,
Last updated: 6/23/2016

Java-based example of using the Kafka Consumer, Producer, and Streaming APIs

Basic example of using Java to create a producer and consumer that work with Kafka on HDInsight. Also a demonstration of the streaming api.

by Larry Franks,
Last updated: 11/10/2016

A UDF that converts various date/time formats to Hive timestamp format

A basic Java-based User Defined Function (UDF) for Hive.