Hacker News new | ask | show | jobs
by typpilol 217 days ago
I feel the same and it's also why I can't understand all these people using small local models.

Every local model I've used and even most open source are just not good

2 comments

the only good-enough model I still use it gpt-oss-120b-mxfp4 (not 20b) and glm-4.6 at q8 (not q4).

quantization ruins models and some models aren't that smart to begin with.

GLM-4.6 is on par with Sonnet 4.5. Sometimes it is better, sometimes it is worse. Give it a shot. It's the only model that made me (almost) ditch Claude. The only problem is, Claude Code is still the best agentic program in town and search doesn't function without a proper subscription.
Have you tried Claude Code Router with GLM 4.6?

https://github.com/musistudio/claude-code-router

z.ai hosted GLM 4.6 works great with claude code, drops right in
Have you tried opencode?