Hacker News new | ask | show | jobs
by c0rruptbytes 2 hours ago
q4 isn't rubbish, but it's a compromise for a good value, q6 is essentially a no-compromise quantization and it's what i recommend for MoEs in my experience for agentic workflows