Skip Navigation
NOW AVAILABLE

General availability: Spark on HDInsight

Published date: 06 June, 2016

Today we're announcing general availability of Spark on Azure HDInsight. This release brings improvements in availability, scalability, and productivity to open-source Apache Spark. 

It's a common sentiment in the industry that big data becomes easier with Spark. Spark has fewer moving pieces and provides a more integrated platform for big-data workloads, from ETL to SQL to machine learning. In addition to that, Spark on Azure HDInsight brings:

  • An industry-leading availability SLA of 99.9 percent, which makes it suitable for demanding enterprise workloads.
  • A scalable storage layer via Azure Data Lake Store.
  • Productivity tools for every phase of data exploration and development. Jupyter notebooks with a customized Spark kernel enable interactive data exploration. Integration with BI dashboards like Power BI, Tableau, and Qlik is good for quick data sharing and continuous reporting. The IntelliJ plug-in is a reliable option for long-term development and debugging of code artifacts.

For more information, check out the following links:

  • HDInsight

Related Products