[jmrm]

AFAIK Google Coral is an inexpensive TPU you can buy right now: https://coral.ai/products/accelerator/

[kmeisthax]

The problem is that this is an "inferencing" accelerator - i.e. it can only execute pretrained models. You cannot train a model on one of these, you need a training accelerator. And pretty much all of those are either NVidia GPUs or cloud-only offerings.

[worldsayshi]

Very cool! Although seems to have no memory to speak of so many use cases like LLM goes away because of that I guess?

[muxamilian]

It has 8 MB of memory. It also supports live streaming the neural network to the chip, although that is slower than when it is cached in the memory.