Hacker News new | ask | show | jobs
by yacine_ 1192 days ago
From my mental math, you can run 4bit quant 7B, but the quality for that might not be what you're looking for.