Y
Hacker News
new
|
ask
|
show
|
jobs
by
c0rruptbytes
2 hours ago
q4 isn't rubbish, but it's a compromise for a good value, q6 is essentially a no-compromise quantization and it's what i recommend for MoEs in my experience for agentic workflows