[asdfologist]

But you said you've been working on those problems for months, so didn't you throw those same problems at Opus?

[knivets]

He has early access to anthropic models, of course he will hype them up, so that they will keep sharing access to preview models with him (and more traffic to his website). It also does't require him to perform any rigorous analysis of model performance, just share how it feels:

> But it's all vibes, if you want a more scientific comparison you'll have to look elsewhere.