Hacker News new | ask | show | jobs
by loufe 972 days ago
That's not true, there are some very pruned (and relatively dumb) LLMs which go under a gig.
2 comments
rubatuga 972 days ago
Small LLMs or large small language models???
link
andy_ppp 972 days ago
What’s the point of a state of the art AI chip that can’t run large models? It seems problematic to say the least!
link
superjan 972 days ago
It is a new design, not a direct competitor for nVidia’s flagship. And there are lots more applications for AI than LLMs.
link
nomel 972 days ago
Realtime, low power, isn't really possible today. Think anything motion or reaction related.
link
jacobgorm 972 days ago
Some of us still work on computer vision. 224MiB is fairly massive for convolutional neural network.
link
Jensson 972 days ago
It can run small models very fast.
link