Hacker News new | ask | show | jobs
by theshrike79 4 days ago
This is the way to do it.

You can have the Big Boy LLM do _everything_. It can and it will do it. It will also cost fucktons of money and take a long time.

But if you build tools (with AI) that do as many tasks in the process deterministically as possible and let the AI use those, it'll be a lot faster and cheaper to run it.

As a bonus you can eventually drop the expensive cloud AI and run a small/medium sized local model instead.

1 comments

You know, i think harnesses and tools are the next "webapps" for the industry. Everyone is going to be making their own. Some will be great some will be meh but i think that's where things are headed.
Yep, there are actual papers written on how you can have a mid-tier model punch way above its weight with an optimised harness and toolset.

Claude is still the best commercially available harness IMO, pi.dev is super good but not something I'd give to non-enthusiasts or would recommend using in an enterprise environment.

I see companies writing their own custom harnesses on top of opencode/pi.dev/crush later down the line. Instead of having a set of skills or MCPs you can just have all of the default stuff built in and automatically updated via normal IT workflows.