Azure HDInsight on Azure Kubernetes Service (AKS)

We are pleased to announce the general availability of the new Azure HDInsight management SDKs for .NET, Python, and Java.

Today we’re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight.

As a high-availability service, Azure HDInsight ensures that you can spend time focused on your workloads, not worrying about the availability of your cluster.

Azure HDInsight offers several ways to monitor your Hadoop, Spark or Kafka clusters. They can be broken down into three main categories: cluster health and availability, resource utilization and performance, and job status and logs.

n the current era, companies generate huge volumes of data every second. Whether it be for business intelligence, user analytics, or operational intelligence; ingestion, and analysis of streaming data requires moving this data from its sources to the multiple consumers that are interested in it.

Migrating on-premises Apache Hadoop® and Spark workloads to the cloud remains a key priority for many organizations. In my last post, I shared “Tips and tricks for migrating on-premises Hadoop infrastructure to Azure HDInsight.

We are pleased to announce the general availability for Azure HDInsight Tools for Visual Studio Code (VSCode). HDInsight Tools for VSCode give developers a cross-platform lightweight code editor for developing HDInsight PySpark and Hive batch jobs and interactive query.

We are excited to share the release of the Microsoft Azure HDInsight Metastore Migration Tool (HMMT), an open-source script that can be used for applying bulk edits to the Hive metastore.

Today we are sharing an update to the Azure HDInsight integration with Azure Data Lake Storage Gen 2.

Today, we are excited to share our tips and tricks series on how to migrate on-premises Hadoop infrastructure to Microsoft Azure HDInsight.

We are excited to announce the general availability of the private endpoint in HDInsight clusters deployed in a virtual network.

One of the biggest security and compliance requirement for enterprise customers is to encrypt their data at rest using their own encryption key. This is even more critical in a post-GDPR world.