Hacker News new | ask | show | jobs
by notglossy 81 days ago
I think generally, SFT is like giving the LLM increased intuition in specific areas. If you combine this with RAG, it should improve the performance or accuracy. Sort of like being a lawyer and knowing something is against the law by intuition, but needing the library to cite a specific case or statute as to why.
1 comments

Thank you I appreciate the reply and that analogy helps make sense of this.