Hacker News new | ask | show | jobs
by GoatInGrey 144 days ago
Sure, but it's still useful insight to see how it performs over time. Of course, cynically, Anthropic could game the benchmark by routing this benchmark's specific prompts to an unadulterated instance of the model.