Apache Spark for Azure HDInsight provides a fast and easy way to run interactive data analysis on large data sets. Spark is an open-source project in the Apache ecosystem that can run large-scale data analytic applications in memory. This allows Spark to deliver queries up to 100 times faster than traditional big data solutions, along with a common execution model for various tasks like extract-transform-load (ETL) processes, batch queries, interactive queries, real-time streaming, machine learning, and graph processing on data stored in Azure Storage.
The Azure cloud helps make Spark deployment easy and cost effective, with no hardware to buy and no software to configure. Plus, Spark comes integrated with popular third-party business intelligence (BI) tools like Microsoft Power BI, in addition to open-source notebooks. There is no additional charge for this feature.
. Microsoft will provide 30 days’ notice via email prior to the expiration of the preview period and any change to the offering, including pricing, in which this feature is available.
For more information, please visit the Apache Spark for HDInsight