[VanillaCafe]

I think there is true emergence coming from these newest large language models, which is something that can't be captured by reducing the system to merely a mathematical Plinko machine. To understand emergent behaviors, the system really does need to be treated like a black box and experimented on.

And a secondary point, what if a large fraction of our intelligence comes from language, not the other way around. If that's true, then we might be well on our way to building the spark of an AGI.

[codemonkey-zeta]

I don't remember where the idea came from, but I heard a hypothesis that basically posited this precise thing. If you look at linguistic history many (if not most) of our words derive ultimately from some analogy to another thing or idea. Our modern languages have embedded in them the combined learning of thousands of generations, and since it is much easier to use the words representing analogies than to come up with and communicate those analogies in the first place, this means anyone who learns a modern language is comparatively brilliant to someone who lived a long long time ago.