|
|
|
|
|
|
by Farmadupe
33 days ago
|
|
|
2 and 3 bit quants are often closer to gibberish than hallucination, and that'll happen regardless of context. I shouldn't claim too much, I haven't tried GLM5.2 at 2/3 bit quantization, but if I were a betting man I'd put money on "useless even as a chatbot" |
|
|