Hacker News new | ask | show | jobs
by renewiltord 833 days ago
Which TPUs do you use? Cloud-hosted or your own hardware? Interesting insight.
3 comments
1024core 833 days ago
"TPUs" are a Google-only product, available* only on GCP.

* Notwithstanding the Choral boards

link
MasterScrat 833 days ago
We started on V3s, now fully moved to V4s with some V5Es, investigating a full move towards V5E & V5P
link
memossy 833 days ago
We use v4s, v5es & v5ps. Mostly v5ps, very stable int8 training (versus the horror that is fp8 stability)
link