[throwaway_19sz]

I disagree with the sentiment. The prompt is not what you meant to say. It is part of the private act of thinking, of choosing your words. The thing you send is what you meant to say. There has always been a vital distinction between what you think and what you say. The notion that you should ever have direct access to private thoughts that someone chose not to send to you is wrongheaded.

It’s like receiving a letter and then demanding to see someone’s private notebook where they jot down their thoughts, so you can see what they ‘really meant to say’. Most communication involves a degree of negotiation and persuasion. Thoughts are necessarily private.

There is a problem with AI generated emails: they change the balance of time/effort required to write them vs. to read them. I think this is a valid concern.

[Planktonne]

> The prompt is not what you meant to say. It is part of the private act of thinking

The private act of thinking does not involve a round trip to a corporation's servers; that would make the whole term meaningless.

[dataflow]

> The private act of thinking does not involve a round trip to a corporation's servers; that would make the whole term meaningless.

Firstly, this is just wrong. People can and do search stuff online as they're writing something up.

Second, your distinction is the one that's meaningless. The LLM could be running locally on a private machine...

[Planktonne]

1. Yes, but the research isn't part of the 'private act of thinking'; it's an input to it.

2. It could; it basically never is though, so let's deal with the general case.

[throwaway_19sz]

You’re missing the point. OK, it’s not ‘thinking’ in a pure sense; the point is it’s private notes. If someone says something to you, they are allowed to privately prepare it first (thinking, jotted notes, LLM rewriting, running it past lawyers, whatever) and you don’t get to see all that. That’s how it has always been.

Just because someone says/writes something to you doesn’t mean you have any moral right to see all the things they considered and then decided not to say.