[rf15]

You are correct, the frameworks around it have improved. In that regard, my assessment is unfair: I only judge the underlying technology and what is sold by the sota providers, with the premise of what it's like when you start fresh. You can achieve a lot by coding around the issues, but that's kinda against the point of 'AI', is it?

[wahnfrieden]

No, its capabilities with a harness are what we are interested in. Your assessment is only relevant to benchmarking, not practical value.

[Barbing]

orwin‘s response in a cousin comment helped me see your original valid point on harnessless LLMs!

>You can achieve a lot by coding around the issues, but that's kinda against the point of 'AI', is it?

Will think on that a bit more.