Hacker News new | ask | show | jobs
by wren6991 17 days ago
Thanks, I wasn't aware of that paper!

I think the popular use of distill (one-hot rather than logits) is not due to Anthropic but due to the DeepSeek-R1 tech report: https://arxiv.org/abs/2501.12948