[briga]

If you ask generic questions, it will give generic answers. The key is to include lots of relevant information and context in your questions. Yes a person might be able to provide more specific advice relating to your situation, but a lot of that is just that they have more context about what you're asking

[a3w]

Do LLMs actually store and reproduce facts? The longer I use LLMs, the lesser i trust facts as complex as "capital of australia" to be answered, truthfully.

[ben_w]

LLMs could be described as storing and reproducing beliefs, but they're definitely not databases that can be easily maintained as things change or verified for perfect accuracy at any given moment.

I think the best way to use them is to have a minimal language model that is as small as possible while still being able to comprehend language; and that this then goes off to an actual knowledge base of some kind where all the factoids can be checked separately.

Humans have separate explicit/declarative memory and implicit/procedural memory memories. I think the Transformer architecture puts everything into what is really only suitable for implicit/procedural; I think RAG is trying to be a separate explicit/declarative memory system, but I'm always to busy to study this in more than a superficial level, so I'm not sure.