[codingslave]

Just recently implemented connected components in a spark job that runs on a 100TB of data.

[bitL]

How long did DFS take? In my experience, with Spark it's like factor of 100 slower than what one would expect on a single machine and a sizable dataset.