[technerder]

Is there anyway to use Google's Coral TPU PCIe Accelerator[1]'s to increase the inference performance of GPT models like this and Llama?

[1] https://coral.ai/products/pcie-accelerator/

[tempaccount420]

Supposedly TPUs are better than GPUs, but everyone other than Google uses GPUs for models.