Hacker News new | ask | show | jobs
by bakugo 71 days ago
You're not doing anything wrong, they are not comparable.

Claims to the tune of "this 0.5B local model running on my phone is almost as good as [large expensive model]" are common but greatly exaggerated, it's simply not true beyond the most basic use cases.

Only the much larger models (such as the 744B GLM-5) manage to come close, but nobody's running those locally.