[famouswaffles]

>I see GPT and similar LLMs as basically like managing an over-eager intern. Have you ever tried to do that?

So? Assuming you're right, GPT-3 was not at the level of intern. GPT-2 could not even write coherent text.

I bet you didn't expect any of those developments either.

It's interesting how much people struggle to look forward. I guess we never needed to for nearly all of our evolutionary history. Like very few people genuinely think they'll be replaced right before they are.

Your argument basically boils down to "I have a hunch language models will stop improving".

Your hunch is unfounded, backed by nothing except vague assertions that "surely this time" these goals won't be reached.

Assertions that many people parroted just a few years ago and have continued to be proven wrong.

The text is data. Gradient descent and prediction will strive the model the data. The data will be modelled. That's really all there is to it.