[orphea]

  By then AI would be good enough to clean them all up...

[citation needed]

To make my comment more on-topic: why do you think this is going to be the case? What newer LLMs will be trained on?

[zuzululu]

well you are assuming that there's not going to be any new progress and that we are going to be stuck with whatever LLM version we have currently

[orphea]

No. I assume that

* we're already close to the ceiling of LLM capabilities: LLM providers probably already consumed everything they could. Plus there have been no large improvements for a while, only small and incremental. I believe Mythos-too-dangerous-to-release is a marketing bullshit, until proved otherwise.

* people generate overengineered slop at light speeds. If that is the training base for future models, I doubt they're going to improve significantly, rather quality is going to stagnate at best.