[libraryofbabel]

Unless you have evidence from a mechanistic interpretability study showing what's happening inside the model when it creates comments, this is really only a plausible-sounding just-so story.

Like I said, it's a trap to reason from architecture alone to behavior.

[energy123]

Yes I should have made it clear that it is an untested hypothesis.