Hacker News new | ask | show | jobs
by drdaeman 480 days ago
The problem with this approach is that LLM gives me unreliable answers. I know this because sometimes I ask things that I used to knew but forgot and needed to refresh my memory - and sometimes the answers were incorrect. So, unfortunately, a search engine validation step is still a necessity.

Asking LLM to provide a link does NOT work, as they hallucinate links just fine, and give links that are either broken or do not contain the information LLM says it should. Using search tools through a LLM (like ChatGPT's "search" function) sort of works (at least the link will be correct - still need to check if the contents means what LLM says it does), but it's quite limited and cannot be fine-tuned (I don't use Google but rather prefer Kagi, and I tend to heavily rely on Kagi's lenses, site: queries and negative terms to scope and refine searches).

In other words: please do NOT trust LLM's answers, even if they sound plausible. Always verify.

1 comments

You aren’t using the paid version of ChatGPT are you? It does a real time search of the web for links.