[ac1spkrbox]

The set of techniques for retrieval is immature, but it's important to note that just relying on model context or few-shot prompting has many drawbacks. Perhaps the most important is that retrieval as a task should not rely on generative outputs.

[danielbln]

It's also subject to significantly more hallucination when the knowledge is baked into the model, vs being injected into the context at runtime.