TPUv3 pods have a stated performance of 100 peta "flops," which is half precision operations on hardware designed specifically for machine learning.
The 200 petaflops number of Summit is referring to general purpose double precision computation. This is totally incomparable to anything the TPU can do at any performance.
The numbers I've seen for a TPU v3 pod are ~100 PFLOPs, whereas this article claims over 3 EFLOPs, so that's at least 30 TPU v3 pods. Arguments about how useful FLOPs as a measure actually are aside, that's still quite a lot of computing power.
> Built for the U.S. Department of Energy, this is a machine designed to tackle the grand challenges of our time. It will accelerate the work of the world’s best scientists in high-energy physics, materials discovery, healthcare and more, with the ability to crank out 200 petaflops of computing power to high-precision scientific simulations.
EDIT: OK, it's 200 PFLOPs of high precision math, 3 EFLOPs of lower precision math. I take my comment back.
The 200 petaflops number of Summit is referring to general purpose double precision computation. This is totally incomparable to anything the TPU can do at any performance.