Hacker News new | ask | show | jobs
by screye 749 days ago
If the crypto wave was any indication, llm asics will gain popularity as general purpose devices like Nvidia gpus get phased out.

I'm hoping the rise of Asics leads to hardware agnostic representations of ML models, or at least seamless conversion from Cuda to other target hardware.

With LLMs standardizing around known instructions, I'm bullish about this family of hardware. Now, they may just get acquired given the infinite money Nvidia has. But, I see their IP being valuable by itself.

I've used Groq, and it's been one of my few 'oh wow' moments of the recent llm cycle.