Hacker News new | ask | show | jobs
by FuckButtons 111 days ago
A 3 bit quant will run on a 128gb MacBook Pro, it works pretty well.
1 comments
nl 111 days ago
A 3 bit quant is quite a lot weaker than the OpenRouter version the OP is using.
link