Hacker News new | ask | show | jobs
by ghostpepper 4 days ago
which quants of 3.5 vs 3.6 did you compare? I guess you're saying that whatever quant you were using, going one lower was worse? ie. 3.5 Q6_K at 22.5GB versus 3.5 Q6_K at 22.9GB?