[TernovskiiA]

I am not an expert in LLM implementations, but I don't know if that is something that is necessarily impossible to solve.

In other words, is it an inherent theoretic limitation, or a practical one, and will be solved in time?

[pk-protect-ai]

It is impossible for now. LLMs need external factual information to be kept in check and decrease hallucinations. That is why phind.com is a good approach for improving LLMs quality, bad is that you can't limit search results to the factual only, all related and unrelated trash found by bing and advertised for money will be topped in results.