Hacker News new | ask | show | jobs
by tbalsam 1191 days ago
I've heard a number of people say (from earlier) that the quantization and default sampling parameters is way wacked. Honestly even running that model size alone is the big achievement here and getting the accuracy to actually reach the benchmark is the beeg next step nao, I believe. <3 :'))))
1 comments

If you run a quantized 60G model and the output is worse than raw 7G model, you can throw your quantizer out.