Hacker News new | ask | show | jobs
by sandGorgon 2261 days ago
>Currently Scala is overwhelmingly used for backend services and/or Spark data pipelines,

This is also being taken over by Python. Databricks Koalas is a pandas interface on top of Spark - https://koalas.readthedocs.io/en/latest/

PySpark was already there (and very much in production). But Koalas (in beta) completely changes the go-to production aspects of spark.