.NET for Apache Spark™ is now available
Published date: April 24, 2019
Apache Spark is now accessible to the .NET developer ecosystem with .NET for Apache Spark. We’re seeing incredible growth with .NET, which is actively used by millions of developers, with over 1 million new developers coming to the platform in the last year. .NET for Apache Spark is free, open source, and .NET Standard compliant, which means you can use it anywhere you write .NET code.
.NET for Apache Spark provides high performance DataFrame-level APIs for using Apache Spark from C# and F#. With these .NET APIs, you can access all aspects of Apache Spark including Spark SQL, for working with structured data, and Spark Streaming. Additionally, .NET for Apache Spark allows you to register and call user-defined functions written in .NET at scale. With .NET for Apache Spark, you can reuse all the knowledge, skills, code, and libraries you already have as a .NET developer.
Microsoft is committed to engaging closely with the Apache Spark community to grow this project and enable more developers to use Apache Spark.