[MichaelMoser123]

maybe ask your favorite language model for advice. They say it's the answer to all questions, sort of like 42.

My point is here: https://youtu.be/_8yVOC4ciXc?t=696 - they explain that gpt3 (almost) learned how to add and multiply, but they don't know how. To me that's the thing. (the insight comes at 12:29, 15:23)

in a sense that is kind of an admission that we don't know what the heck what is going on. That's kind of stronger than the claim to "strong AI".

Being able to define a system as being as a "Strong Ai" assumes that we would still know hat is actually going on. An understanding of what is going on would imply a claim of understanding of what is happening, that in turn implies a claim of being in charge of show.

(Maybe that's a cyperpunk way of looking at the whole frigging show ;-)