Hacker News new | ask | show | jobs
by nathanasmith 460 days ago
Unfortunately that wouldn't help as much as you think since talented AI labs can just watch the public leaderboard and note what models move up and down to deduce and target whatever the hidden benchmark is testing.