Y
Hacker News
new
|
ask
|
show
|
jobs
by
redwood_
139 days ago
I run Qwen3-Coder-Next (Qwen3-Coder-Next-UD-Q4_K_XL) on the Framework ITX board (Max+ 395 - 128GB) custom build. Avg. eval at 200-300 t/s and output at 35-40 t/s running with llama.cpp using rocm. Prefer Claude Code for cli.
1 comments
Hackbraten
137 days ago
Curiously, how come you chose -Q4_K_XL instead of -Q8_K_XL?
link