[Sinidir]

Yes these things happen as part of RL Training. Same way that you can see the "But wait ..." phrases in thinking traces. They get rewarded.

[f3408fh]

Out of curiosity, how does something like "But wait..." get rewarded?

[vintagedave]

The human (or other entity) judging it probably thinks it looks like a sign of thinking or reasoning, and doing a better job -- catching its own errors before they are confidently surfaced. That would be worth rewarding.