[1718627440]

Well I agree with you that LLMs really like to answer with stuff, that is not grounded in reality, but I also agree with the parent, that grounding it in something else absolutely helps. I let the LLM invent garbage how ever it feels like, but then tell it to only ever answer with a citing valid existing URLs. Suddenly it generates claims, that something doesn't exist or it truly doesn't know.

This really results in zero hallucination (but the content is also mostly not generated by a LLM).

[andrepd]

Well I don't know what to say, except that this is obviously, trivially, not true. The LLM will plain make up links that don't exist, or at least "summarise" an existing link by just making stuff up that is tangentially (but plausibly) related to the link. It's impossible to have used LLMs for this purpose for more than a quarter of an hour and not have seen this.

[1718627440]

I never had the case, that an URL did not exist. For me it shows stuff like "generating web search", so I guess it tries to fetch the URL first, before suggesting it. LLMs like to give tangentially related links, but this is typically paired with a sentence, that the link I really asked for, does not exist.

> It's impossible to have used LLMs for this purpose for more than a quarter of an hour and not have seen this.

You may be generalizing too much from your experience.