Hacker News new | ask | show | jobs
by arresin 510 days ago
Link has all the params but running at 4 bit quant.
1 comments
qingcharles 509 days ago
4-bit quant is generally kinda low, right?

I wonder how badly this quant affects the output on DeepSeek?

link