They are claiming to be the first to achieve >50% saturation during training. Pretty sure I recall Midjourney is using TPUv4 pods too
https://cloud.google.com/blog/products/ai-machine-learning/g...
https://cloud.google.com/tpu/docs/system-architecture-tpu-vm