Hacker News new | ask | show | jobs
by coder543 795 days ago
At what quantization? 4-bit is 80GB. Less than 4-bit is rarely good enough at this point.