[ozr]

That's not what RAG is. RAG is the process of adding relevant information to a prompt in an LLM. It's a form of in-context learning.

[mr_toad]

It’s right there in the name - first you Retrieve relevant information (often a vector lookup) then you use it to Augment the prompt, then you Generate an answer.

It’s bloody useful if you can’t cram your entire proprietary code base into a prompt.

[kergonath]

What makes it useful is precisely that it is not learning.

[ozr]

Yes it is; it's just not updating the weights.

https://ai.stanford.edu/blog/understanding-incontext/