Hacker News new | ask | show | jobs
by bugglebeetle 44 days ago
Anthropic serves quantized versions of their models and you can run q8 locally.
1 comments

I don't even use Sonnet anymore. Current feels worse than Claude 3.5 couple years ago. They have quantized that much? Switched to GPT 5.5, let's see how long it will stay good.
The problem with GPT is it doesn't have the same wholistic worldview of the problem space as Claude
Hmm, what that means or how can you even measure it? At least for all my recent problems, GPT 5.5 has performed better.