[realce]

What does indistinguishable even mean here?

If a fish could write a novel, would you find what it wrote interesting, or would it seem like a fish wrote it? Humans absorb information relative to the human experience, and without living a human existence the information will feel fuzzy or uncanny. AI can approximate that but can't live it for real. Since it is a derivative of an information set, it can never truly express the full resolution of it's primary source.

[skeledrew]

All that may or may not be the case, but whether or not it is, given that AI is trained on the works of humanity, it only stands that it'll inevitably get to the point where the content it creates will evoke the same response as if created by a human. "Roses are red" is composed of the same bit sequence, regardless of creator.