[kgwgk]

> I still think I'd be using

That's fine. Other people may not want to pay 300x more and will rather make do with last year's SOTA.

> For coding you always want to go with the best model

Maybe you meant "For coding I always want to go with the best model"?

[mesmertech]

Based on current market for LLMs I'd say my use of "you" in the general is fine. Even openrouter which doesn't capture all of the SOTA closed models but nearly all of opensource model usage has Opus as 1st(on last week) on "Programming" category and 3rd in overall rankings

https://openrouter.ai/rankings

[simonw]

I'd trust the OpenRouter rankings a lot more if they exposed the number of unique users for each model, as opposed to just a token count.

Currently I have no way of telling if big changes in their rankings are caused by a single "whale" switching providers, or if it's a more meaningful trend.

[mesmertech]

My point was that even openrouter, the one place people who are looking for open source SOTA models go to, doesn't definitively have opensource models at the top. Esp considering quite a lot of the closed models usage is through AWS, GCP , Azure etc, probably dwarfing the usage on openrouter by a huge factor