Hacker News new | ask | show | jobs
by mannykannot 55 days ago
Yes - a point supported the Vera benchmark: https://github.com/aallan/vera-bench
1 comments

The benchmark is strange: single-run results (the author acknowledges it's unreliable) and uses older models like GPT-4o or Opus 4 (although the benchmark is from 2026).