Hacker News new | ask | show | jobs
by mh2266 144 days ago
I don't exactly disagree with this but I have seen models simply deleting the tests, or updating the tests to pass and declaring the failures were "unrelated to my changes", so it helpfully fixed them
2 comments

I’ve had to deal with this a handful of times. You just have to make it restore the test, or keep trying to pass a suite of explicit red-green method tests it wrote earlier.
Yes. You have to treat the model like an eager yet incompetent worker, i.e. don't go full yolo mode and review everything they do.