Hacker News new | ask | show | jobs
by alex_sf 61 days ago
Open models, in actual practice, don't match up to even one or two generation prior models from Anthropic/OpenAI/Google. They've clearly been trained on the benchmarks. Entirely possible it was by mistake, but it's definitely happening.
2 comments

GLM 5.1 is absolutely on par with Sonnet 4.5, sometimes better in practice (it holds abstractions over longer context windows better)

It’s about the only one that is at that level though to be fair. They’re all still useful, still!

That hasn’t been my experience. For coding at least I find little difference between closed and open models