Hacker News new | ask | show | jobs
by bscphil 3 days ago
> It's implicitly assumed when you read something that a person write it.

I basically agree, but it's more specific than that, I think. The basic promise is that the writer believes the thing you are writing. This is a feature of human speech that is so central that Grice made it part of one of the maxims of his pragmatic theory of conversation: "do not say what you believe to be false" or "that for which you lack adequate evidence."

In writing, using generative AI destroys the pragmatic basis for this conversational maxim, because it means that a consequential number of "people" you and I talk to online are not really people at all. They're entirely artificial, and the text generated was never even read by a human, certainly not a statement of a human's actual beliefs about anything. (This isn't even a human-preferring standard, the problem with LLM text is that even the LLM doesn't believe it.) Even in cases where a human does interact with the text in some capacity before it is published, it's likely that a plurality to a majority of the ideas reflected in the text come from a language model that does not actually believe them.

Writing is something that aids in the development of human ideas. It's not just that in the ideal case, a human being will have certain ideas and be able to communicate them to other people. Rather, we often have inchoate, unclear, or even contradictory ideas and opinions, and the process of writing itself leads us to figure out what it is, exactly, that we believe. So even in the "ideal" case of someone like OP who engages with LLMs more critically, and claims responsibility for every bit of text they publish, the process is still detrimental to the production and communication of true beliefs because their ideas were formed in dialogue with an agent that did not actually believe them. It's a process that is dangerous to bypass because you skip most of the thinking involved in writing without even realizing it.