Hacker News new | ask | show | jobs
by naveen99 1 day ago
Isn’t that distillation ?
1 comments
mrfox321 1 day ago
No. Distillation trains on a teach model's logits or output tokens.
link