[Smaug123]

I have run the experiment like seven times now on different tracts of text, given to people who are not me. It’s a point of simple fact that Opus 4.7 can identify me when I’m writing fresh text in my voice. Does that change your conclusion if you were to grant it for the sake of argument (notwithstanding the fact that it’s actually true)? Or is your objection “it can identify one of your voices, the most commonly used one, and not the others” or something like that?

[runako]

Correct -- it can identify one of your (current) voices, written with your knowledge that the text will be used for the purpose of having an LLM determine whether you wrote it. This is a mentalist setup.

Expanding on that...you are fully capable of writing e.g. product instructions, or marketing copy, or religious verse, or a poem, or a fictional quote from a fictional character in your upcoming novel. I would consider it unlikely that any LLM could identify you as the writer of any of those (though Claude might infer it was you given your chat history). The point is that Pangram claims to be able to do exactly that!

Pangram is also making the claim that they can, to a high degree of certainty, identify when someone else wrote text and claimed it to be yours. This, when Pangram has not ever seen a writing sample of either writer. This is quite obviously ridiculous!