[willy_k]

> Also, from a scientific perspective, distillation is decades old and contributes nothing scientifically.

Distillation itself does not, but it does enable research by allowing more teams to play around with models that follow the frontier, as opposed to completely independent training including scaffolding up w/ synthetic data.