Y
Hacker News
new
|
ask
|
show
|
jobs
by
cpburns2009
58 days ago
Anyone else getting gibberish when running unsloth/Qwen3.6-35B-A3B-GGUF:UD-IQ4_XS on CUDA (llama.cpp b8815)? UD-Q4_K_XL is fine, as is Vulkan in general.
1 comments
cpburns2009
58 days ago
Apparently it's a known issue with CUDA 13.2 [1].
[1]
https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/discussi...
link
danielhanchen
56 days ago
Yes sadly CUDA 13.2 is broken - NVIDIA will push a fix in CUDA 13.3
link
[1] https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF/discussi...