This filled me with nostalgia. I remember how excited I was -- maybe even in awe -- when, in 2008, IBM's Roadrunner broke the PetaFLOPS barrier and was the first computer to do so. That's not even that long ago.
Ha, my memory is how tera-scale was the motivating target for all the high-performance research when I was in college. If I stop to think about it, it still seems dissonant to think that a random gamer's GPU has more power than that now.