[Imanari]

I don't know who you are and how you are so sure about 'what top labs are actually doing' but I have a similar feeling about the issue. The models dont have to 'actually learn', the setup has to approximate 'actual learning' just well enough to be usefull.

> AND it can inherit all the accumulated memories/docs from its predecessor.

So we are talking about a whole system, not just the model? Reminds me of something I heard a while back 'AGI will be a product, not a model'

[drakenot]

It reminds me of the standard counter to the Chinese Room thought experiment: the person inside doesn’t understand Chinese, but the system _does_. The person, the rules, and the lookup tables together form the thing doing the understanding.