[sosodev]

A human could also describe chocolate without ever having tasted it. Do you believe that experience is a requirement for consciousness? Could a human brain in a jar not be capable of consciousness?

To be clear, I don't think that LLMs are conscious. I just don't find the "it's just in the training data" argument satisfactory.

[glitchc]

Without having seen, heard of, or tasted any kind of chocolate? Unlikely.

[sosodev]

Their description would be bad without some prior training of course but so would the LLM's.