[furyofantares]

> It isn’t the actual thinking that drove the model’s actions in a session- but a summary of the thinking logic. This is like using saving a jpeg as a .bmp and then editing the .bmp and presenting it as a .jpeg. The conversion produces data loss.

You've got that backwards, .bmp is a lossless format and .jpeg is the lossy one.

[0o_MrPatrick_o0]

My bad! 10 points for House Slytherin!

[altmanaltman]

also a typo in the last sentence you're vrs your

[glaslong]

Weirdly pleasant, if minor, signal of human authorship

[Silagi]

I'm convinced this "signal" has already been hijacked. Maybe a Baader-Meinhof phenomenon, but I've noticed more and more egregious spelling errors that make little sense from a human perspective. Hop into whatever chatbot you'd like and ask it to "write a paragraph with subtle misspellings on long but common words", and you'll notice misspellings that just feel wrong, because they don't map to a clear misunderstanding that a person could have.

Or maybe I'm losing it after reading too much slop. Also distinctly possible.

[Tomte]

In a parallel universe LLMs have learned that (a) the training material contains many different orthographic errors and (b) that humans follow a non-obvious pattern when "deciding" which error to make, so that their generated output contains such errors, as well.

In our universe LLMs seem to have learned that those errors do not follow patterns in the aggregate and that they should not be emulated.

[tekne]

The raw pretrained models make the errors, I believe -- we then reinforcement-learn them out.

[genxy]

Not for long!

[altmanaltman]

Yeah, definitely it's a nice thing in today's context, weirdly. But also, you shouldn't really be making typos if you're writing an article and are using a basic spellcheck.

The text is clearly human-written just because it doesn't smell like AI (in this case, even if it was written by AI and produced this particular output, that's okay imo). I deal a lot with AI writing and writing in general, as I worked as an editor in another life so it's natural to me to see writing and form an objective opinion on it.

[0o_MrPatrick_o0]

I missed my coffee! Ty! Five points to Slytherin.

[altmanaltman]

wait till my father hears about this!