Monday, April 29, 2019
The Jupyter Notebook on HDInsight Spark clusters is useful when you need to quickly explore data sets, perform trend analysis, or try different machine learning models. Not being able to track the status of Spark jobs and intermediate data can make it difficult for data scientists to monitor and optimize what they are doing inside the Jupyter Notebook.
Wednesday, April 24, 2019
We are truly at a unique tipping point in the history of technology. The pace of growth is more rapid than ever before, with estimates of more than 150B connected devices and data growth up to 175 Zettabytes by 2025.
Wednesday, January 23, 2019
We are pleased to announce the general availability for Azure HDInsight Tools for Visual Studio Code (VSCode). HDInsight Tools for VSCode give developers a cross-platform lightweight code editor for developing HDInsight PySpark and Hive batch jobs and interactive query.
Monday, December 10, 2018
Today we are sharing an update to the Azure HDInsight integration with Azure Data Lake Storage Gen 2. This integration will enable HDInsight customers to drive analytics from the data stored in Azure Data Lake Storage Gen 2 using popular open source frameworks such as Apache Spark, Hive, MapReduce, Kafka, Storm, and HBase in a secure manner.
Thursday, November 15, 2018
We are pleased to reveal the release of Spark Interactive Console in Azure Toolkit for IntelliJ. This new component intends to facilitate your Spark job authoring, and enable you to run code interactively in a shell-like environment within IntelliJ.
Wednesday, October 3, 2018
Organizations around the world are gearing up for a future powered by data, cloud, and Artificial Intelligence. This week at Spark + AI Summit Europe, I talked about how Microsoft is committed to delivering cutting-edge innovations that help our customers navigate these technological and business shifts.
Monday, September 17, 2018
We are happy to announce that HDInsight Tools for Visual Studio Code (VS Code) now leverage VS Code built-in user settings and workspace settings to manage HDInsight clusters and Spark job submissions.
Monday, June 18, 2018
Household names such as Adobe, Jet, ASOS, Schneider Electric, and Milliman are amongst thousands of enterprises that are powering their Big Data Analytics using Azure HDInsight.
Thursday, May 10, 2018
Microsoft will have a major presence at Spark + AI Summit, 2018, in San Francisco, the premier event for the Apache Spark community. Rohan Kumar, Corporate Vice President of Azure Data, will deliver…
Thursday, April 26, 2018
We are happy to announce that HDInsight Tools for VSCode now supports argparse and accepts parameter based Pyspark Job submission. We also enabled the tools to support Spark 2.2 for PySpark author and job submission.