Reminder, this is in the context of "dumb human" prompting.
The task is to build a MIPS interpreter to run Doom. The "failed" workflow decided that it couldn't prove Doom was booting correctly by just checking one frame, and it decided to check multiple frames (hence /tmp/frame-N.bmp).
Arguably a better solution, but obviously fails a brittle test case.
The MIPS interpreter worked, but the verifier doesn't actually check that it works, just that a specific frame is logged.
The task is to build a MIPS interpreter to run Doom. The "failed" workflow decided that it couldn't prove Doom was booting correctly by just checking one frame, and it decided to check multiple frames (hence /tmp/frame-N.bmp).
Arguably a better solution, but obviously fails a brittle test case.
The MIPS interpreter worked, but the verifier doesn't actually check that it works, just that a specific frame is logged.