Wednesday, March 13, 2019
Azure HDInsight offers several ways to monitor your Hadoop, Spark or Kafka clusters. They can be broken down into three main categories: cluster health and availability, resource utilization and performance, and job status and logs.
Tuesday, February 5, 2019
n the current era, companies generate huge volumes of data every second. Whether it be for business intelligence, user analytics, or operational intelligence; ingestion, and analysis of streaming data requires moving this data from its sources to the multiple consumers that are interested in it.
Thursday, January 31, 2019
Migrating on-premises Apache Hadoop® and Spark workloads to the cloud remains a key priority for many organizations. In my last post, I shared “Tips and tricks for migrating on-premises Hadoop infrastructure to Azure HDInsight.”
Wednesday, January 23, 2019
We are pleased to announce the general availability for Azure HDInsight Tools for Visual Studio Code (VSCode). HDInsight Tools for VSCode give developers a cross-platform lightweight code editor for developing HDInsight PySpark and Hive batch jobs and interactive query.
Tuesday, January 22, 2019
We are excited to share the release of the Microsoft Azure HDInsight Metastore Migration Tool (HMMT), an open-source script that can be used for applying bulk edits to the Hive metastore.
Thursday, January 17, 2019
We recently introduced support for HDInsight in Azure CLI as a public preview. With the addition of the new HDInsight command group, you can now utilize all of the features and benefits that come with the familiar cross-platform Azure CLI to manage your HDInsight clusters.
Monday, December 10, 2018
Today we are sharing an update to the Azure HDInsight integration with Azure Data Lake Storage Gen 2. This integration will enable HDInsight customers to drive analytics from the data stored in Azure Data Lake Storage Gen 2 using popular open source frameworks such as Apache Spark, Hive, MapReduce, Kafka, Storm, and HBase in a secure manner.
Thursday, December 6, 2018
HDInsight covers a wide variety of big data technologies, and we have received many requests for a detailed guide. Whether you want to just get started with HDInsight, or become a Big Data expert, this post has you covered with all the latest resources.
Thursday, November 15, 2018
We are pleased to reveal the release of Spark Interactive Console in Azure Toolkit for IntelliJ. This new component intends to facilitate your Spark job authoring, and enable you to run code interactively in a shell-like environment within IntelliJ.
Thursday, November 8, 2018
Today, we are excited to share our tips and tricks series on how to migrate on-premises Hadoop infrastructure to Microsoft Azure HDInsight.