Learn about important Azure product updates, roadmap, and announcements. Subscribe to notifications to stay informed.RSS feed
Three new security feature improvements are available for Azure HDinsight.
This new release enables you to perform Jupyter-like notebook operations and boosts collaborations with one-click conversion between IPYNB and PY files.
Target availability: Q2 2020
Azure HDInsight enterprise security enhancements include support for customer-managed key encryption with Azure Key Vault and a new feature, ID broker, which simplifies authentication setups.
Microsoft now fully supports distributions of Apache analytics projects in-house. Also, we will soon launch the next generation of HDInsight with improved provisioning and management experience, reserved instance pricing, low-priority virtual machines (VMs) and auto-scale.
Target availability: Q1 2020
Starting on 30th June 2020, Azure HDInsight will enforce TLS 1.2 or later versions for all HTTPS connections. We recommend that you ensure that all your clients are ready to handle TLS 1.2 or later versions.
Azure HDInsight is now available in the UAE North region.
Beginning 6th April, 2020, customers will be able to choose only 4-core or higher virtual machines (VMs) as head nodes for the new HDInsight clusters. Existing clusters will continue to run as expected.
Azure HDInsight now supports the use of service tags to simplify inbound network security group (NSG) rule management. Azure service tags group multiple IP addresses under a single user friendly tag. Administrators need to only create rules by referring to the tags while Microsoft takes the responsibility of keeping the IP addresses up to date. Administrators maintaining Azure HDInsight clusters can now benefit from this manageability improvement.
Autoscale for Azure HDInsight is now generally available across all regions for Apache Spark and Hadoop workloads. This feature makes it possible to operate your big data analytics workloads in a more cost-efficient and productive way, so you can drive higher use of your HDInsight clusters and pay only for what you need.
Target availability: Q4 2019
The accelerated writes feature in the HDInsight HBase cluster attaches a Premium SSD managed disk to every region server (worker node). Write ahead logs are configured to be written to Hadoop Distributed File System (HDFS) mounted on premium managed disks instead of standard Azure page blobs. Premium managed disks are SSD-based and offer excellent I/O performance with fault tolerance. Using premium managed disks for WALs allows us to separate write ahead log storage from Apache HBase data storage.
A new Azure HDInsight capability enables you to customise and upgrade your Azure SQL Database for Apache Ambari during cluster creation.
Target availability: Q4 2019
The integration of Azure HDInsight and Azure Firewall, in order to restrict outbound traffic from the cluster to unauthorised destinations, is now generally available.
Target retirement date: October 31, 2019
Azure HDInsight will deprecate G-series virtual machines (VMs) on 31st October 2019. After this date, you will not be able to create any new clusters using G-series VMs or to scale up clusters having G-series nodes.
Azure CLI support for Azure HDInsight is now generally available. This enables administrators to easily manage their HDInsight clusters using simple Azure CLI commands.
Azure HDInsight now supports Apache Spark 2.4 and Apache Kafka 2.1. You can choose the Spark or the Kafka version that you want during cluster creation in the Azure portal. Both updates come with several new features, hundreds of bug fixes and improvements.
Azure HDInsight has updated against the vulnerabilities that affect the Linux kernel.
We are pleased to announce the integration of VSCode Python extension to handle PySpark interactive for HDInsight in VSCode. The Azure HDInsight Tools for VSCode leverages the Python extension to…
HDInsight for VSCode continues to boost the experience of Hive users with self-service exploratory capabilities. The HDInsight explorer in VSCode not only empowers you to browse Hive databases across…
We have corrected billing for Azure SQL Data Warehouse and other Azure services that impacted EA customers only.
HBase accelerated writes significantly improves the value proposition for low-latency, high- throughput NoSQL workloads.
Azure at Build
Read the Azure blog for the latest news.Blog
Tell us what you think of Azure and what you want to see in the future.Provide feedback
Azure is available in more regions than any other cloud provider.Check product availability in your region