Understanding HDInsight Spark jobs and data through visualizations in the Jupyter Notebook


The Jupyter Notebook on HDInsight Spark clusters is useful when you need to quickly explore data sets, perform trend analysis, or try different machine learning models. Not being able to track the status of Spark jobs and intermediate data can make it difficult for data scientists to monitor and optimize what they are doing inside the Jupyter Notebook.

Senior Program Manager, Big Data Team

HDInsight Tools for Visual Studio Code の一般提供開始


Azure HDInsight Tools for Visual Studio Code (VSCode) の一般公開を発表いたします。開発者は、HDInsight Tools for VSCode を使用することで、HDInsight PySpark の開発や Hive バッチ ジョブおよび対話型クエリ向けの、複数プラットフォームに対応した軽量コード エディターを手にすることができます。

Principal Program Manager, Big Data Team

HDInsight now supported in Azure CLI as a public preview


We recently introduced support for HDInsight in Azure CLI as a public preview. With the addition of the new HDInsight command group, you can now utilize all of the features and benefits that come with the familiar cross-platform Azure CLI to manage your HDInsight clusters.

Program Manager, Azure HDInsight

Azure HDInsight integration with Data Lake Storage Gen2 preview - ACL and security update


Today we are sharing an update to the Azure HDInsight integration with Azure Data Lake Storage Gen 2. This integration will enable HDInsight customers to drive analytics from the data stored in Azure Data Lake Storage Gen 2 using popular open source frameworks such as Apache Spark, Hive, MapReduce, Kafka, Storm, and HBase in a secure manner.

Principal Program Manager, Azure HDInsight