Get the latest updates on Azure products and features to meet your cloud investment needs. Subscribe to notifications to stay informed.RSS feed
Azure HDInsight now supports virtual network service endpoint policies, which allow you to filter HDInsight egress virtual network traffic to certain Azure storage accounts.
HDInsight now fully supports distributions of Apache analytics projects in-house. Plus, in the coming months, we’re launching the next generation of HDInsight with new and improved features.
Three new security feature improvements are available for Azure HDinsight.
This new release enables you to perform Jupyter-like notebook operations and boosts collaborations with one-click conversion between IPYNB and PY files.
Target availability: Q2 2020
Azure HDInsight enterprise security enhancements include support for customer-managed key encryption with Azure Key Vault and a new feature, ID broker, which simplifies authentication setups.
Microsoft now fully supports distributions of Apache analytics projects in-house. Also, we’ll soon launch the next generation of HDInsight with improved provisioning and management experience, reserved instance pricing, low-priority virtual machines (VMs), and auto-scale.
Target availability: Q1 2020
Starting on June 30, 2020, Azure HDInsight will enforce TLS 1.2 or later versions for all HTTPS connections. We recommend that you ensure that all your clients are ready to handle TLS 1.2 or later versions.
Azure HDInsight is now available in the UAE North region.
Beginning April 6, 2020, customers will be able to choose only 4-core or higher virtual machines (VMs) as head nodes for the new HDInsight clusters. Existing clusters will continue to run as expected.
Azure HDInsight now supports the use of service tags to simplify inbound network security group (NSG) rule management. Azure service tags group multiple IP addresses under a single user friendly tag. Administrators need to only create rules by referring to the tags while Microsoft takes the responsibility of keeping the IP addresses up to date. Administrators maintaining Azure HDInsight clusters can now benefit from this manageability improvement.
Autoscale for Azure HDInsight is now generally available across all regions for Apache Spark and Hadoop workloads. This feature makes it possible to operate your big data analytics workloads in a more cost-efficient and productive way, so you can drive higher use of your HDInsight clusters and pay only for what you need.
Target availability: Q4 2019
The accelerated writes feature in the HDInsight HBase cluster attaches a Premium SSD managed disk to every region server (worker node). Write ahead logs are configured to be written to Hadoop Distributed File System (HDFS) mounted on premium managed disks instead of standard Azure page blobs. Premium managed disks are SSD-based and offer excellent I/O performance with fault tolerance. Using premium managed disks for WALs allows us to separate write ahead log storage from Apache HBase data storage.
A new Azure HDInsight capability enables you to customize and upgrade your Azure SQL Database for Apache Ambari during cluster creation.
Target availability: Q4 2019
The integration of Azure HDInsight and Azure Firewall, in order to restrict outbound traffic from the cluster to unauthorized destinations, is now generally available.
Target retirement date: October 31, 2019
Azure HDInsight will deprecate G-series virtual machines (VMs) on October 31, 2019. After this date, you won't be able to create any new clusters using G-series VMs or to scale up clusters having G-series nodes.
Azure CLI support for Azure HDInsight is now generally available. This enables administrators to easily manage their HDInsight clusters using simple Azure CLI commands.
Azure HDInsight now supports Apache Spark 2.4 and Apache Kafka 2.1. You can choose the Spark or the Kafka version that you want during cluster creation in the Azure portal. Both updates come with several new features, hundreds of bug fixes and improvements.
Azure HDInsight has updated against the vulnerabilities that affect the Linux kernel.
We are pleased to announce the integration of VSCode Python extension to handle PySpark interactive for HDInsight in VSCode. The Azure HDInsight Tools for VSCode leverages the Python extension to…
HDInsight for VSCode continues to boost the experience of Hive users with self-service exploratory capabilities. The HDInsight explorer in VSCode not only empowers you to browse Hive databases across…
Azure at Build
Read the Azure blog for the latest news.Blog
Tell us what you think of Azure and what you want to see in the future.Provide feedback
Azure is available in more regions than any other cloud provider.Check product availability in your region