Hacker News new | ask | show | jobs
by laborcontract 373 days ago
You do you, and if it works i’m not going to argue with your results, but for others, finetuning is the wrong tool for knowledge injection over a well-designed RAG pipeline.

Finetuning is good for, like you said, doing things a particular way but that’s not the same thing as being good at knowledge injection and shouldn’t considered as such.

It’s also much easier to prevent a RAG pipeline from generating hallucinated responses. You cannot finetune that out of a model.