Skip Navigation

HDInsight

Azure HDInsight integration with Data Lake Storage Gen2 preview - ACL and security update

Monday, December 10, 2018

Today we are sharing an update to the Azure HDInsight integration with Azure Data Lake Storage Gen 2. This integration will enable HDInsight customers to drive analytics from the data stored in Azure Data Lake Storage Gen 2 using popular open source frameworks such as Apache Spark, Hive, MapReduce, Kafka, Storm, and HBase in a secure manner.

Principal Program Manager, Azure HDInsight

Azure Toolkit for IntelliJ – Spark Interactive Console

Thursday, November 15, 2018

We are pleased to reveal the release of Spark Interactive Console in Azure Toolkit for IntelliJ. This new component intends to facilitate your Spark job authoring, and enable you to run code interactively in a shell-like environment within IntelliJ.

Principal Program Manager, Big Data Team

Bring Your Own Keys for Apache Kafka on HDInsight

Wednesday, October 3, 2018

One of the biggest security and compliance requirement for enterprise customers is to encrypt their data at rest using their own encryption key. This is even more critical in a post-GDPR world. Today, we’re announcing the public preview of Bring Your Own Key (BYOK) for data at rest in Apache Kafka on Azure HDInsight.

Program Manager, Azure Big Data