Hacker News new | ask | show | jobs
by cubefox 86 days ago
Some yes, others no. Distillation and quantization can't be used to make new base models since they require a preexisting one.
1 comments

it enables models larger than was previously possible.
No because the base model from which the distilled or quantized models are derived is larger.