Y
Hacker News
new
|
ask
|
show
|
jobs
by
thot_experiment
19 days ago
q6 is fine for that qwen with ctx @ q8, and the dense models of that size are solid at q4 with q8 ctx