Hacker News new | ask | show | jobs
by londons_explore 1842 days ago
It's design is pretty specific to Google's TPU.

If you ran it elsewhere, you'd likely need to tweak the design or suffer quite a big performance penalty.

1 comments

Nope, probably not. It's using JAX, which works on both GPUs and TPUs.
All the constants in the design will be tuned to fit perfectly in TPU hardware dimensions.