[dancrystalbeach]

Ok, Spark isn’t dead. Before you leave, I’m sorry for lying to you. Sorta. Kinda. Not really.

Undoubtedly Apache Spark has reached its zenith, shot like a rocket out of the Databricks barrel into the sky. The world is shifting though, even if ever so imperceptible.

First, open source Spark has been taken over, corralled and tammed by the corporate workings and money trains. It’s the fault of no one really, it’s the world we live in. Very few open source projects truly stand the test of time, uncorrupted by outside forces.