| I run Qwen3.6 on RTX4090, and it does amazing job for the most parts. For coding task, one needs to break the session among multiple calls
I made https://github.com/aka-rider/orqestra but it's possible to do the same in almost any modern harness directly. The main idea is:
- separate session that burns context on reading code and calling tools (context7, etc) -> markdown report "here are relevant patrts of code, docs" "with evidence" to prevent hallucinations - separate session for planning (architect)
- (critic <-> architect) 1-3 times because small model skip over details
- worker <-> validator, again, the same reason Qwen3.6 can run for hours looking for a complex bugs in read-only mode, and usually it gets it. Proposed fix would probably be hacky, but so as Sonnet's Qwen3.6 can mechanically write code by Opus-made plan. You would have to prompt afterwards: "Review your own changes. Any bugs? Cross-validate against the original plan - any gaps? Any violations of CLAUDE.md" But again, I need to do this for Sonnet.
But also I use local llms for reindexing knowledge base. Grooming tickets: I can leave a caveman note "single panel for errors rendering, move all error messages" and come back to 90% ready specs with the end goal and context. |
My favorite example is Godot; most local models just can't get it through their thick AI skull that code alone won't be enough to generate working solutions. They must accept a more complex harness, or you must provide much more info that eats the precious available context on every run.