Hacker News new | ask | show | jobs
by bensyverson 29 days ago
I don't think "90% correct in a tenth the time" is really the tradeoff. For a well-specified task, it's closer to 100% correct in 1/100th the time. But that undersells the time required to generate a good spec.

For under-specified tasks, it's not really accurate to talk about "correctness," because the machine isn't psychic. I would suggest that given a high-level feature request like "add streaming support" it's more about acceptance probability. In a well-structured and well-documented codebase, and a reasonably sized feature request, there might be an 80% chance it will generate something which is 100% acceptable. But there's about a 99% chance it will generate something which is acceptable after 1-2 revisions.