Hacker News new | ask | show | jobs
by MAESTRO1955 2 days ago
AI psychometrics becomes more important than its benchmarks.
1 comments

I certainly agree. As we lose the ability to properly "test" these AI systems, we must focus more on how they behave. A system can ace every benchmark in existence and still be profoundly untrustworthy. I'm interested to hear from others if there are benchmarks that are immune to reward hacking or saturation.