Hacker News new | ask | show | jobs
by weinzierl 377 days ago
Is there a way to figure out likely quantization from the output. I mean, does quantization degrade output quality in certain ways that are different from other modification of other model properties (e.g. size or distillation)?