Hacker News new | ask | show | jobs
by nasreddin 44 days ago
not totally true anymore. check out https://programbench.com/

new models like Fable were scoring 30%. wouldnt be suprised if very soon we eclipse 50%