[rlupi]

This gave me a nice idea.

It would be nice to build a local LLM + wikipedia tool, that uses the LLM to assemble a general answer and then search wikipedia (via full-text search or rag) for grounding facts. It could help with hallucinations of small models a lot.

[Tempat1]

I feel like there could be way more of that kind of thing - LLMs backed by a database of info or accurate tools.

e.g. At the risk of massively oversimplifying a complex issue, LLMs are bad at maths; couldn’t we have them use the calculator?

[rlupi]

LLM tools do exactly that. That's why most online LLMs (openai, gemini) have access to sandboxed python for calculations.