[emodendroket]

You could say that calling it "lying" is unduly anthropomorphizing the LLM, but then so is saying it "believes" something to be true.