[Schnitz]

If distillation leads to a model that is much cheaper to run yet provides similar intelligence then why doesn’t Anthropic distill their own models?

[ashu1461]

Don't they do it already ? Aren't smaller models distilled versions of bigger models