Hacker News new | ask | show | jobs
by kgeist 33 days ago
Yep, Gated DeltaNet in Qwen3.6 requires much less VRAM for the KV cache than previous generations. Plus the KV cache is 8-bit.
1 comments

is it in llama.cpp?