[anileated]

Remember how in those Stable Diffusion paintings for common objects the wrongness is subtly creeping in (out of proportion body parts, misshapen fingers, etc.), while less commonly encountered ideas and objects can be really off (which we might notice… or not)? Now transfer that to human relationships and psychology.

Humans mirroring each other is a deep feature of our psychology. One can only be self-aware as human when there are other humans to model oneself against, and how those humans interact with you forms you as a person. So now a human modelling oneself against a machine? Mirroring an inhuman unthinking software tool superficially pretending to be human? What could go wrong?