Hacker News new | ask | show | jobs
by Saris 48 days ago
Qwen3.6-35b-a3b at 64k context runs quite well on my 12GB VRAM GPU with MoE partially offloaded to CPU. It does use a good chunk of system RAM too, but I get about 40-50 tok/s.