Hacker News new | ask | show | jobs
by jokethrowaway 825 days ago
I don't get what's special about Devin. I noticed the same logic issues I've seen with ChatGPT or Copilot or Gemini.

OpenAI already did spend quite a bit on software development reinforcement learning and we already have models with huge context windows.

We've already seen OSS projects where ai agents collaborate to create code projects.

If you use CodeLlama, throw some engineering manpower to create feedback loop with compilers, linters and other tooling to improve the code generated you can probably match Devin's performance. I can get some pretty good results feeding back compiler's output to ChatGPT, if that were automated, my impression of ChatGPT would be much better.

So my bet is that an open source Devin is absolutely possible.

1 comments

> I don't get what's special about Devin.

Did you watch the YouTube videos?

I’m also skeptical it can do all the things it appears to be able to do, but I think it’s undeniable that what they show it doing (totally unverified as it is)…

…is significantly more capable than any other programming agent I’ve seen.

If openAI had that capability, they would be selling it.

They are not. I doubt very much that they’re just hoarding it and keeping it to themselves; gpt4 just can’t do it out of the box.

It is not that simple.

It is not just a fancy prompt for gpt4.

If it was that easy, someone would have done a year ago.

> If you use CodeLlama

Oh come on. These pathetic little open source models are shit compared the vendor offerings.

This is daydreaming about what might be, not what actually exists.

If it was that easy, someone would have done a year ago

Devin isn't as original as it's marketing claims, there are prior tools in this space (eg. Sweep). I've no idea whether it's significantly better than them, but certainly the magic is the underlying LLM, not Devin.

No reason at all why other devs - including open source - can't continue to provide competitors at that same surface level.