[MrPowers]

Spark 3 was released this year: https://databricks.com/blog/2020/06/18/introducing-apache-sp...

Almost entirely backwards compatible with huge performance gains.