Y
Hacker News
new
|
ask
|
show
|
jobs
by
Keats
129 days ago
Testing speed is easy yes, I'm mostly wondering about the quality difference between Q6 vs Q8_K_XL for example.
1 comments
danielhanchen
128 days ago
I haven't done benchmarking yet (plan to do them), but it should be similar to our post on DeepSeek-V3.1 Dynamic GGUFs:
https://unsloth.ai/docs/basics/unsloth-dynamic-2.0-ggufs
link