Hacker News new | ask | show | jobs
by fxtentacle 940 days ago
I personally fine-tuned it with QAT = quantisation aware training and custom extensions to induce the sparsity.

https://pytorch.org/docs/stable/quantization.html#quantizati...