Hacker News new | ask | show | jobs
by usaar333 128 days ago
i'd interpret that as rounding error. that is unchanged

swe-bench seems really hard once you are above 80%

1 comments

it's not a great benchmark anymore... starting with it being python / django primarily... the industry should move to something more representative
Openai has; they don't even mention score on gpt-5.3-codex.

On the other hand, it is their own verified benchmark, which is telling.