Hacker News new | ask | show | jobs
by jmorgan 1022 days ago
Q4_0 is often mentioned as being the "tried and true" quantization level to try first. I've heard folks have had good results with 3-bit quantization (Q3_K_M) as well
1 comments

just tried it and its not good. I think one of the better feedback was asking for play an adventure in the style of Space Quest 1