[petercooper]

I'm not disagreeing with your broader point but:

So in effect it becomes an exercise of "can you fool the human into thinking this is a plausible thing Hemingway would've said". ... There's something unsettling that so many people cannot seem to cut clearly through this illusion.

Modern culture, at all scales, is largely based upon such exercises. We rarely know exactly what something (whether a person, organization or entity) truly stands for, with messages often boiled down, contextualized, or re-interpreted through others or through simulations.

People go to theme parks and enjoy rides simulating the wild west and meet characters who resemble, but aren't, their favorite characters from TV (which themselves are a fabrication based upon other, real things). Many cultural (heck, also religious) experiences are an exercise in humans entering into a suspension of disbelief and thinking something is plausible when it has little relation to the original thing it symbolizes. Indeed, the comforting thing about AI may be that at least we can see that process taking place more clearly with it.