|
|
|
|
|
|
by _puk
341 days ago
|
|
|
Haven't they already started to regress? I'm bullish on specific areas improving (I'm sure you could selectively train an LLM on the latest Angular version to replace the majority of front-end devs given enough time and money, it's a limited problem space and a strongly opinionated framework after all), but for the most part enshittification is already starting to happen with the general models. Nowadays even ChatGPT doesn't bother to even refer to the original question posed after a few responses, so you're left summarising a conversation and starting a new context to get anywhere. So, yeah, I think we're very much into finding the equilibrium now. Cost vs scale. Exponential improvements won't be in the general LLMs. Happy to be wrong on this one.. |
|
|
Whatever model is cheap to provide inference for free is irrelevant when it comes to discussing SOTA AI capabilities and their impact. The state of the art has been reliably improving markedly over the past 3 years. o3, Claude opus 4, gemini-2.5 all surpass their predecessors in every benchmark and indicate that improvement isn't slowing down.
If GPT-5 comes out and it's somehow worse then I'll concede to your point, but so far the claim that the latest models are getting worse is mere speculation and makes no sense given that most labs are already aware of the potential for data contamination and such and have taken measures to ensure high data quality for the models they're spending hundreds of millions to train.