[nl]

TPUs have the second best software stack after CUDA though. JAX and Tensorflow support it before CUDA in some cases and it's the only Pytorch environment that comes close to CUDA for support.

[pjmlp]

TPUs are single case use, contrary to CUDA.