Data scientists have a dynamic role. They need environments that are fast and flexible while upholding their organization’s security and compliance policies. Notebook Virtual Machine (VM), announced in May 2019, resolves these conflicting requirements while simplifying the overall experience for data scientists.
We are pleased to reveal the preview of HDInsight IO Cache, a new transparent data caching feature of Azure HDInsight that provides customers with up to a 9x performance improvement for Apache Spark jobs.
Apache Spark 2.3.0 is now available for production use on the managed big data service Azure HDInsight. Ranging from bug fixes (more than 1400 tickets were fixed in this release) to new experimental features Apache Spark 2.3.0 brings advancements and polish to all areas of its unified data platform.
The big data teams on Azure will host a special Ask Me Anything session on /r/Azure, Thursday, November 17, 2016 from 10:00 am to 2:00 pm PST.
Today we are pleased to announce the refresh of the Apache Spark support on Azure HDInsight clusters.
Today, we are announcing release of Microsoft Avro Library. This release is a result of collaborative effort of multiple teams in Microsoft. The release brings complete and performant .NET…