[psytrancefan]

It does make me question humans and thinking but in the opposite direction.

It is like sitting down at a piano, sight reading a piece from sheet music and then someone who has no idea what they are talking about claiming you composed the music on the fly. Then when you point out the sheet music they just double down on some bullshit as to why they are still right and that is still composing even though obviously it is not.

[ngneer]

Best analogy so far. I am adopting this for the next wave of "wait until the next model" and "but humans hallucinate, too" comments. Yes, when we feed back our own output (language on the web) into ourselves, things become tricky to tease apart, and it would seem like intelligence to us. Then again, the mechanical turk appears intelligent, too. If we point out how it works, then the "magic" should vanish.