Hacker News new | ask | show | jobs
by famouswaffles 655 days ago
>You don't need to morph the problem to require out-of-distribution knowledge to get it to fail

make the slight variation look different from the version it have memorized and it often passes. Sometimes it's as straightforward as just changing the names. humans have this failure mode too.