[kennywinker]

Unless you have a LOT of VRAM (>16gb), you’ll want to use a 2, 3, or 4 bit quantization of qwen3.6-35b-a3b. Ollama is a quick way to try this out and see what perf you can get, tho you’ll want to move to a better tool (vLLM, llama.cpp, etc) if you end up using it seriously.

Use pi.dev as your agent harness, and point it at ollama or whatever you’re running your model in.

Since qwen3.6-35b-a3b is a “MoE” model (indicated by the a3b part), you can get away with a lot less VRAM and a slower GPU. For me, 35b-a3b performs about as well as a 12b “dense” model. You’ll still need enough RAM+VRAM to hold the entire model - otherwise it’ll be super slow as it loads pieces of the model off disk for every token. Loading from RAM to VRAM is slower than having the whole thing in VRAM but better than involving your ssd.