Hacker News new | ask | show | jobs
by abhikrc 807 days ago
No it does not need an unit test to work. We responded to another similar question from another user.
2 comments
prmph 807 days ago
Then how can you have confidence that it actually fixes the bug? It means you still need a human to review the fix, no?
link
yuntong 807 days ago
The developer written testcases are provided in SWE-bench-lite so those could be used to check the generated patches.

The auto-generated patches are to reduce the effort of resolving issues. In practice, they should be reviewed and verified by human developers before they are integrated.

link
rrr_oh_man 807 days ago
Thank you for the clarification. And shame on me for talking out of my ass!
link