[righthand]

I don’t understand the “chips designed for AI workloads” sentiment I hear all the time. Llms were designed using Gpus. The hardware already exists, so what will make it use less energy in a world where Gpus over the last decade have only become bigger, hotter, more power hungry hardware? If we could develop Llm on anything less we probably would have shifted back to Cpus already.

[minimaxir]

Google's TPUs are an example of efficient chips designed for AI workloads, and were in development before the LLM boom.

It's just hard to replicate the power and efficiency of CUDA.