Hacker News new | ask | show | jobs
by gugagore 642 days ago
Generally (not just for LLMs) this is called student-teacher training and/or knowledge distillation.
1 comments

It reminds me of when I take notes from a textbook then intensively review my own notes
And then when it comes time for the test, I end up hallucinating answers too.