[stickfigure]

I think this is not quite true. They feel "shame"... right up until you wipe the context window. And then they forget any valuable lesson they might have learned.

The problem with LLMs is that they live in eternal September. Keeping a few bits of compressed residual context around isn't enough to offset the refreshed naivete.