[mellosouls]

For it to be far away means that at some point the exponential has to stop

Not if we are on the wrong path, going in the wrong direction, which I think was at least partly the point of the comment to which you are responding.

There is a school of thought that something fundamental is being missed by modern AI and the (amazing) success of GPT3+ ironically risks directing us further down that wrong path at an accelerating pace.

[throwawayadvsec]

I'm pretty sure AGI will not be one model.

But a collection of models, with some kind of vector databases(or something more efficient than that), being orchestrated by one or multiple master models.

A large LLM that knows pretty much everything there is to know about the world, seems like a good building block for an AGI, no matter how the rest is built.

LLM's could be like the Broca's and Wernicke's area of an AGI brain. working in unison with dozens of other parts.

[worrycue]

Or LLMs aren’t involved at all. After all LLMs work at the level of word tokens … how fundamental really are words to AGI level intelligence; the human brain doesn’t operate on the level of words, words are something we picked up, that a more fundamental mechanism at play deals with.

[throwawayadvsec]

Humanity wasn't doing anything significant before words.

[worrycue]

Words help communicate ideas between people, allowing society to advance greatly, but it isn’t necessary for thinking.

[ChatGTP]

Kids workout how to manipulate parents well before they can speak?