Hacker News new | ask | show | jobs
A verification loop 4x'd DeepSeek's intelligence, matching Opus at 1/7 the cost (ironbee.medium.com)
39 points by sozal 24 days ago
3 comments

From what I understood, the gist of it is that uses a bunch of skills in a loop to help LLMs solve the tasks better via browser-testing, debugging, visual-testing, etc..

The skills can be found here:

https://github.com/ironbee-ai/ironbee-devtools-skills/tree/m...

Question that was left unanswered:

How much longer does a 4x DeepSkeep loop took compared to Opus?

DeepSeek at 1/7 the cost of Opus is the real story here. The only downside is paying for it — Alipay/WeChat only. api-hub.cc lets you use DeepSeek V4 with any credit card, same API.
Seems interesting, but buried under a mountain of written slop.
It is marketing for some SaaS thing. However, I think something like this, "verification loops with some sort of tricks", is what Anthropic and "OpenAI" do behind the scene with their interfaces.
Fair on the length. The verification loop took DeepSeek from ~20 to ~80 on Web-Bench, matching Opus at ~7x less cost. Curious if the method holds up for you.
Well I don’t know what the method is, there’s a mention of ironbee, but I’m not willing to spend the time digging through this to figure out what’s needed and how to set it up.
> I’m not willing to spend the time digging through this to figure out what’s needed

That's the neat part. You don't... need to do this yourself nowadays. AI agent is perfectly capable to figure out any new open source thing that pops up daily now. You can just give it the link to the repo and say "Set this up for me. I wanna play with it."

until you realize people are putting malicous instructions in the projects now, at least a few anti-Ai coders see this as an act of defiance
I don't think that kind of people builds AI tools. Also you can and should sandbox your AI when trying out something sus.
You could literally send it to an ai
Absolutely not.

If someone vomits the slop that must be fed to a robot to make sense of it, even if there's something of value.

It's just so rude, like a professor entering the class, emptying a carton box full of papers on the floor, flipping a bird and leaving without a word.

It's possible there's something good in it.

Zero engagement with anything the post actually says. You've spent more words performing your distaste than it would've taken to read the thing. Recycling slop as a catch all for "I didn't read it" is the real content free contribution here.
Or the people writing this could spend more effort to make it not slop. If they can’t be bothered, I won’t waste my time figuring out if this is worth it, there’s are 1000 other articles to read and techniques to try.

And if this is worth a look, I’m sure I’ll hear about it again from someone who wrote it better.

Or just don't read the blog post and stop posting your slop here so everyone will be happy