[lmm]

> Doesn’t that predispose that it knows which parts of the distribution do and don’t have mistakes, and therefore that it knowingly makes mistakes unless you ask it not to?

Of course it does, to the extent it "knows" anything. It replies in a way that's average for the distribution. If you tell it this is an important task and not to make mistakes, it will give you a response that's more like that of someone who's been told this is an important task and not to make mistakes.