{"id":1430,"date":"2019-04-15T00:00:00","date_gmt":"2019-04-15T00:00:00","guid":{"rendered":"https:\/\/azure.microsoft.com\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight"},"modified":"2025-06-20T06:07:48","modified_gmt":"2025-06-20T13:07:48","slug":"announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight","status":"publish","type":"post","link":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/","title":{"rendered":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><img loading=\"lazy\" decoding=\"async\" title=\"image\" src=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\" alt=\"image\" width=\"89\" height=\"89\" align=\"left\">Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security. With the general availability of Apache Hadoop 3.0 on Azure HDInsight, we are building upon existing capabilities with a number of key enhancements that further improve performance and security, and deepen support for the rich ecosystem of big data analytics applications.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"bringing-apache-hadoop-3-0-and-supercharged-performance-to-the-cloud\">Bringing Apache Hadoop 3.0 and supercharged performance to the cloud<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Apache Hadoop 3.0 represents over 5 years of major upgrades contributed by the open source community across key Apache frameworks such as Hive, Spark, and HBase. New features in Hadoop 3.0 provide significant improvements to performance, scalability, and availability, reducing total cost of ownership and accelerating time-to-value.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>Apache Hive 3.0<\/strong> \u2013 With ACID transactions on by default and several performance improvements, this latest version of Hive enables developers to build \u201ctraditional database\u201d applications on massive data lakes. This is particularly important for enterprises who need to build GDPR\/privacy compliant big data applications.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Hive Warehouse Connector for Apache Spark<\/strong> \u2013 With the Hive Warehouse Connector, the Spark and Hive worlds are coming closer together. The new connector moves the integration from the metastore layer to the query engine layer. This enables higher, more reliable performance with predicate pushdown and other functionality.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Apache HBase 2.0 and Apache Phoenix 5.0<\/strong> \u2013 Apache HBase 2.0 and Apache Phoenix 5.0 introduce a number of performance, stability, and integration improvements. With HBase 2.0, periodic reorganization of the data in the memstore with in-memory compactions improves performance as data is not flushed or read too often from remote cloud storage. Phoenix 5.0 brings more visibility into queries with query log by introducing a new system table that captures information about queries that are being run against the cluster.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Spark IO Cache<\/strong> \u2013 IO Cache is a data caching service for Azure HDInsight that improves the performance of Apache Spark jobs. IO Cache also works with <a href=\"https:\/\/tez.apache.org\/\" target=\"_blank\" rel=\"noopener\">Apache TEZ<\/a> and <a href=\"https:\/\/hive.apache.org\/\" target=\"_blank\" rel=\"noopener\">Apache Hive<\/a> workloads, which can be run on <a href=\"https:\/\/spark.apache.org\/\" target=\"_blank\" rel=\"noopener\">Apache Spark<\/a> clusters.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"enhanced-enterprise-grade-security\">Enhanced enterprise grade security<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Enterprise grade security and compliance is a critical requirement for all customers building big data applications that store or process sensitive data in the cloud.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>Enterprise Security Package (ESP) support for Apache HBase<\/strong> \u2013 With the general availability of ESP support for HBase, customers can ensure that users authenticate to their HDInsight HBase clusters using their corporate domain credentials and are subject to rich, fine-grained access policies (authored and managed in Apache Ranger).<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>Bring Your Own Key (BYOK) support for Apache Kafka<\/strong> \u2013 Customers can now bring their own encryption keys into the Azure Key Vault and use them to encrypt the Azure Managed Disks storing their Apache Kafka messages. This gives them a high degree of control over the security of their data.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"rich-developer-tooling\">Rich developer tooling<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Azure HDInsight offers rich development experiences with various integrated development environment (IDE) extensions, notebooks, and SDKs.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><strong>SDKs general availability<\/strong> \u2013 HDInsight SDKs for <a href=\"https:\/\/docs.microsoft.com\/dotnet\/api\/overview\/azure\/hdinsight\" target=\"_blank\" rel=\"noopener\">.NET<\/a>, <a href=\"https:\/\/docs.microsoft.com\/python\/api\/overview\/azure\/hdinsight\" target=\"_blank\" rel=\"noopener\">Python<\/a>, and <a href=\"https:\/\/docs.microsoft.com\/java\/api\/overview\/azure\/hdinsight\" target=\"_blank\" rel=\"noopener\">Java<\/a> enable developers to easily manage clusters using the language of their choice.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>VSCode<\/strong> \u2013 <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/hdinsight\/hdinsight-for-vscode\" target=\"_blank\" rel=\"noopener\">HDInsight VSCode extension<\/a> enables developers to submit Hive batch jobs, interactive Hive queries, and PySpark scripts to HDInsight 4.0 clusters.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><strong>IntelliJ<\/strong> \u2013 <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/hdinsight\/spark\/apache-spark-intellij-tool-plugin\" target=\"_blank\" rel=\"noopener\">Azure Toolkit for IntelliJ<\/a> enables Scala and Java developers to program Spark, Scala, and Java projects with built-in templates. Developers can easily perform local run, local debug, open interactive sessions, and submit Scala\/Java projects to HDInsight 4.0 Spark clusters directly from the IntelliJ integrated development environment.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"broad-application-ecosystem\">Broad application ecosystem<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Azure HDInsight supports a vibrant application ecosystem with a variety of <a href=\"https:\/\/azure.microsoft.com\/en-us\/services\/hdinsight\/partner-ecosystem\/\" target=\"_blank\" rel=\"noopener\"><strong>popular big data applications available on Azure Marketplace<\/strong><\/a>, covering scenarios from interactive analytics to application migration. We are excited to support applications such as:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.starburstdata.com\/presto-azure\/\" target=\"_blank\" rel=\"noopener\"><strong>Starburst (Presto)<\/strong><\/a> \u2013 Presto is an open source, fast, and scalable distributed SQL query engine that allows you to analyze data anywhere within your organization. Architected for the separation of storage and compute, Presto can easily query data in Azure Blob Storage, Azure Data Lake Storage, SQL and NoSQL databases, and other data sources. Learn more and explore <a href=\"https:\/\/azuremarketplace.microsoft.com\/en-us\/marketplace\/apps\/starburst.starburst-presto?tab=Overview\" target=\"_blank\" rel=\"noopener\">Starburst Presto on Azure Marketplace<\/a>.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/kyligence.io\/partners\/microsoft\/\" target=\"_blank\" rel=\"noopener\"><strong>Kyligence<\/strong><\/a> \u2013 Kyligence is an enterprise online analytic processing (OLAP) engine for big data, powered by Apache Kylin. Kyligence enables self-service, interactive business analytics on Azure, achieving sub-second query latencies on trillions of records and seamlessly integrating existing Hadoop and BI systems. Learn more and explore <a href=\"https:\/\/azuremarketplace.microsoft.com\/en-us\/marketplace\/apps\/kyligence.kyligence?tab=Overview\" target=\"_blank\" rel=\"noopener\">Kyligence on Azure Marketplace<\/a>.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/www.wandisco.com\/partners\/ms-azure\" target=\"_blank\" rel=\"noopener\"><strong>WANDisco<\/strong><\/a> \u2013 WANDisco Fusion de-risks migration to the cloud by ensuring disruption-free data migrations, easy and seamless extensions of Spark and Hadoop deployments, and short or long term hybrid data operations. Learn more and explore <a href=\"https:\/\/azuremarketplace.microsoft.com\/en-us\/marketplace\/apps\/wandisco.fusion-hdi-app?tab=Overview\" target=\"_blank\" rel=\"noopener\">WANDisco on Azure Marketplace<\/a>.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/unraveldata.com\/unravel-data-collaborates-microsoft-azure-boost-performance-reliability-big-data-workloads-cloud\/\" target=\"_blank\" rel=\"noopener\"><strong>Unravel Data<\/strong><\/a> \u2013 Unravel provides a unified view across your entire data stack, providing actionable recommendations and automation for tuning, troubleshooting, and improving performance. The Unravel Data app uses Azure Resource Manager, allowing customers to connect Unravel to a new or existing HDInsight cluster with one click. Learn more and explore <a href=\"https:\/\/azuremarketplace.microsoft.com\/en-us\/marketplace\/apps\/unravel-data.unravel-app\" target=\"_blank\" rel=\"noopener\">Unravel on Azure Marketplace<\/a>.<\/li>\n\n\n\n<li class=\"wp-block-list-item\"><a href=\"https:\/\/microsoft-my.sharepoint.com\/personal\/andow_microsoft_com\/Documents\/HDInsight\/Waterline\" target=\"_blank\" rel=\"noopener\"><strong>Waterline Data<\/strong><\/a> \u2013 With Waterline Data Catalog and HDInsight, customers can easily discover, organize, and govern their data, all at the global scale of Azure. Learn more and explore <a href=\"https:\/\/azuremarketplace.microsoft.com\/en-\/marketplace\/apps\/waterline_data.waterline_data?tab=Overview\" target=\"_blank\" rel=\"noopener\">Waterline on Azure Marketplace<\/a>.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"get-started-now\">Get started now<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We look forward to seeing what innovations you will bring to your users and customers with Azure HDInsight. Read the <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/get-up-to-speed-with-azure-hdinsight-the-comprehensive-guide\/\" target=\"_blank\" rel=\"noopener\">developer guide<\/a> and follow the <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/hdinsight\/hadoop\/apache-hadoop-linux-tutorial-get-started\" target=\"_blank\" rel=\"noopener\">quick start guide<\/a> to learn more about implementing open source analytics pipelines on Azure HDInsight. Stay up-to-date on the latest Azure HDInsight news and exciting features coming in the near future by following us on Twitter (#AzureHDInsight). For questions and feedback, please reach out to AskHDInsight@microsoft.com.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"about-azure-hdinsight\">About Azure HDInsight<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Azure HDInsight is an enterprise-ready service for open source analytics that enables customers to easily run popular Apache open source frameworks including Apache Hadoop, Spark, Kafka, and others. The service is available in 30 public regions and Azure Government Clouds in the US and Germany. Azure HDInsight powers mission critical applications for a wide range of sectors and use cases including ETL, streaming, and interactive querying.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ms_queue_id":[],"ep_exclude_from_search":false,"_classifai_error":"","_classifai_text_to_speech_error":"","_alt_title":"","footnotes":"","msx_community_cta_settings":[]},"categories":[1474],"tags":[],"audience":[3054,3057,3053],"content-type":[1465],"product":[2895],"tech-community":[],"topic":[],"coauthors":[7],"class_list":["post-1430","post","type-post","status-publish","format-standard","hentry","category-analytics","audience-business-decision-makers","audience-data-professionals","audience-it-decision-makers","content-type-announcements","product-azure-hdinsight-on-azure-kubernetes-service-aks","review-flag-1680286581-295","review-flag-2-1680286581-601","review-flag-3-1680286581-173","review-flag-4-1680286581-250","review-flag-5-1680286581-950","review-flag-anywh-1680286580-635","review-flag-free-1680286579-836","review-flag-gener-1680286584-335","review-flag-new-1680286579-546","review-flag-partn-1680286579-300"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog<\/title>\n<meta name=\"description\" content=\"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog\" \/>\n<meta property=\"og:description\" content=\"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\" \/>\n<meta property=\"og:site_name\" content=\"Microsoft Azure Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/microsoftazure\" \/>\n<meta property=\"article:published_time\" content=\"2019-04-15T00:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-20T13:07:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\" \/>\n<meta name=\"author\" content=\"Arindam Chatterjee\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@azure\" \/>\n<meta name=\"twitter:site\" content=\"@azure\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Arindam Chatterjee\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\"},\"author\":[{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/arindam-chatterjee\/\",\"@type\":\"Person\",\"@name\":\"Arindam Chatterjee\"}],\"headline\":\"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight\",\"datePublished\":\"2019-04-15T00:00:00+00:00\",\"dateModified\":\"2025-06-20T13:07:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\"},\"wordCount\":1005,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\",\"articleSection\":[\"Analytics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\",\"name\":\"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog\",\"isPartOf\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\",\"datePublished\":\"2019-04-15T00:00:00+00:00\",\"dateModified\":\"2025-06-20T13:07:48+00:00\",\"description\":\"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.\",\"breadcrumb\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog home\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Analytics\",\"item\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/analytics\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#website\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"name\":\"Microsoft Azure Blog\",\"description\":\"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.\",\"publisher\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization\",\"name\":\"Microsoft Azure Blog\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"contentUrl\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp\",\"width\":512,\"height\":512,\"caption\":\"Microsoft Azure Blog\"},\"image\":{\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/microsoftazure\",\"https:\/\/x.com\/azure\",\"https:\/\/www.instagram.com\/microsoftdeveloper\/\",\"https:\/\/www.linkedin.com\/company\/16188386\",\"https:\/\/www.youtube.com\/user\/windowsazure\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117\",\"name\":\"shakir\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g\",\"caption\":\"shakir\"},\"sameAs\":[\"https:\/\/azure.microsoft.com\"],\"url\":\"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog","description":"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/","og_locale":"en_US","og_type":"article","og_title":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog","og_description":"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.","og_url":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/","og_site_name":"Microsoft Azure Blog","article_publisher":"https:\/\/www.facebook.com\/microsoftazure","article_published_time":"2019-04-15T00:00:00+00:00","article_modified_time":"2025-06-20T13:07:48+00:00","og_image":[{"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp","type":"","width":"","height":""}],"author":"Arindam Chatterjee","twitter_card":"summary_large_image","twitter_creator":"@azure","twitter_site":"@azure","twitter_misc":{"Written by":"Arindam Chatterjee","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#article","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/"},"author":[{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/arindam-chatterjee\/","@type":"Person","@name":"Arindam Chatterjee"}],"headline":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight","datePublished":"2019-04-15T00:00:00+00:00","dateModified":"2025-06-20T13:07:48+00:00","mainEntityOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/"},"wordCount":1005,"commentCount":0,"publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp","articleSection":["Analytics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/","name":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight | Microsoft Azure Blog","isPartOf":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage"},"thumbnailUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp","datePublished":"2019-04-15T00:00:00+00:00","dateModified":"2025-06-20T13:07:48+00:00","description":"Today we\u2019re announcing the general availability of Apache Hadoop 3.0 on Azure HDInsight. In partnership with Cloudera, Microsoft Azure is the first cloud provider to offer customers the benefit of the latest innovations in the most popular open source analytics projects, with unmatched scalability, flexibility, and security.","breadcrumb":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#primaryimage","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2019\/04\/83a7344f-289d-4e39-b87b-59119bc43c18.webp"},{"@type":"BreadcrumbList","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/announcing-general-availability-of-apache-hadoop-3-0-on-azure-hdinsight\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog home","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/"},{"@type":"ListItem","position":2,"name":"Analytics","item":"https:\/\/azure.microsoft.com\/en-us\/blog\/category\/analytics\/"},{"@type":"ListItem","position":3,"name":"Announcing general availability of Apache Hadoop 3.0 on Azure HDInsight"}]},{"@type":"WebSite","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#website","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","name":"Microsoft Azure Blog","description":"Get the latest Azure news, updates, and announcements from the Azure blog. From product updates to hot topics, hear from the Azure experts.","publisher":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/azure.microsoft.com\/en-us\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#organization","name":"Microsoft Azure Blog","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","contentUrl":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-content\/uploads\/2024\/06\/microsoft_logo.webp","width":512,"height":512,"caption":"Microsoft Azure Blog"},"image":{"@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/microsoftazure","https:\/\/x.com\/azure","https:\/\/www.instagram.com\/microsoftdeveloper\/","https:\/\/www.linkedin.com\/company\/16188386","https:\/\/www.youtube.com\/user\/windowsazure"]},{"@type":"Person","@id":"https:\/\/azure.microsoft.com\/en-us\/blog\/#\/schema\/person\/c702e5edd662b328b49b7e1180cab117","name":"shakir","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g7664e653ea371ce16eaf75e9fa8952c4","url":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9342c7c05bb16548741bc5cd3a3e3b7ee0c8e746844ad2cc582db5beb5514c6f?s=96&d=mm&r=g","caption":"shakir"},"sameAs":["https:\/\/azure.microsoft.com"],"url":"https:\/\/azure.microsoft.com\/en-us\/blog\/author\/shakir\/"}]}},"msxcm_display_generated_audio":false,"msxcm_animated_featured_image":null,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Microsoft Azure Blog","distributor_original_site_url":"https:\/\/azure.microsoft.com\/en-us\/blog","push-errors":false,"_links":{"self":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1430","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/comments?post=1430"}],"version-history":[{"count":1,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1430\/revisions"}],"predecessor-version":[{"id":42669,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/posts\/1430\/revisions\/42669"}],"wp:attachment":[{"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/media?parent=1430"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/categories?post=1430"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tags?post=1430"},{"taxonomy":"audience","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/audience?post=1430"},{"taxonomy":"content-type","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/content-type?post=1430"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/product?post=1430"},{"taxonomy":"tech-community","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/tech-community?post=1430"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/topic?post=1430"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/azure.microsoft.com\/en-us\/blog\/wp-json\/wp\/v2\/coauthors?post=1430"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}