Hacker News new | ask | show | jobs
by QuercusMax 33 days ago
Yeah, it's been fun for me running models (mostly Qwen 3.6 27B) on my 48GB M4 MacBook Pro. When i'm using it to run models, it's basically unusable for anything else - I actually do the work on my Macbook Neo. Took me a while to figure out why the models couldn't figure out how to make tool calls - because LMStudio by default uses a 32K input window, which is smaller than OpenCode's prompt, so half of the instructions were being pruned from the middle!
1 comments
dofm 33 days ago
Yes — there is a setting for that isn't there. And as soon as you realise there's a setting for that, you have new knowledge.

Qwen barely needs any of Opencode's prompt, in my experience; I think I cut it down to about three general lines I found by googling. Mainly you need only a pre-amble to make sure that the plan mode, plan switch and build mode prompt fragments make sense.

Gemma 4 also needs almost nothing at all, which is fascinating, considering it is not a coding-specialist model. It just seems to be who you need it to be when you ask.

link
hypfer 32 days ago
What are those 3 lines you've cut it down to?
link
QuercusMax 31 days ago
I've been using pi-coder the couple days with Qwen, and its minimal prompt works MUCH better than OpenCode's bloated prompt.
link
dofm 31 days ago
I was going to reply with my answer but I tested it again and realised that actually in some cases the custom prompt is somehow being ignored, so I don’t truly know how good it actually is in opencode.

Poking around in the convoluted opencode source or the overstuffed github issues to try to make sense of exactly what is happening has convinced me to switch to pi as well, simply to have a thing I can more fully understand. I am using paseo anyway for the GUI on the Mac, so switching agents is easy enough and pi has always seemed like it might be the right choice in principle. Initially I just picked opencode as the easiest path but now it feels like the time.

link
QuercusMax 31 days ago
That was basically the conclusion I came to after I spent a couple hours trying to puzzle my way through opencode's settings - extremely opaque and hard to tell what's happening. Pi is simpler, and i figure if I really need a better system prompt, that's literally what AGENTS.md is for, right?
link