Hacker News new | ask | show | jobs
by lucubratory 1022 days ago
There are various methods for removing unused parts of the model, like distillation. The idea is generally that you always lose performance, but hopefully you lose more size/runcost than you do performance, proportionately.