Hacker News new | ask | show | jobs
by tombert 2620 days ago
How is this different than Mobius [1]?

[1] https://github.com/Microsoft/Mobius

2 comments

Here's my understanding:

- Mobius is .NET Framework / Mono based and x-plat isn’t great, .NET for Apache Spark is .NET Core / .NET Standard and built with x-plat as a primary concern

- Mobius only targets up to Spark 2.0; while Spark LTS is up to 2.4 now

- .NET for Apache Spark is built to take advantage of .NET Core performance improvements, showing big advantages over Python and R bindings, especially when user defined functions are a major factor

- .NET for Apache Spark is driven by lessons learned and customer demand, including major big data users inside and outside Microsoft

Disclaimer: I know people that worked on this and helped from .NET Foundation side, but the above is my non-official summary from readme's and stuff.

From the github repo: https://github.com/dotnet/spark#inspiration-and-special-than...

>> Mobius: C# and F# language binding and extensions to Apache Spark, a pre-cursor project to .NET for Apache Spark from the same Microsoft group.