[dmezzetti]

While there is truth here, they can be quite effective as a logic engine vs a fact engine. One of the most popular LLM use cases is retrieval augmented generation (RAG), where the LLM is limited by a provided context.

Do you need 7B/13B/33B/77B parameters to do this? That is a question up for debate and something I'm exploring with the concept of micro/nano models (https://neuml.hashnode.dev/train-a-language-model-from-scrat...). There is the sense that today's LLMs could be overkill for a problem such as RAG.