Hacker News new | ask | show | jobs
by idf00 742 days ago
Luckily it's not one or the other. You can fine tune and use RAG.

Sometimes RAG is enough. Sometimes fine tuning on top of RAG is better. It depends on the use case. I can't think of any examples where you would want to fine tune and not use rag as well.

Sometimes you fine tune a small model so it performs close to a larger varient on that specific narrow task and you improve inference performance by using a smaller model.