[uoaei]

The new LLMs have been advertised in layman circles often as something like "a chatbot with access to all the information on the web" or something similarly ambiguous. So it is certainly easy to imagine why people think it literally goes out and checks its sources by re-accessing the webpage and summarizing it for the user. The responses you quoted seem to simulate/imply that kind of behavior through its natural language presentation.

[jakelazaroff]

Yeah, I've spoken to people who've had trouble internalizing that it can't search the web even after I've explicitly told them that. The "upon double-checking" message from ChatGPT is especially egregious — it's straight-up lying about how it arrived at that response. There really should be a layer on top of the chat UI to alert the user if it detects a response like that.