Hacker News new | ask | show | jobs
Why AI Needs a "Genie Coefficient" (spectrum.ieee.org)
5 points by mikelgan 11 days ago
1 comments

Major benchmarks measure what AI can do. None measure whether it does what you mean: the distance between what you ask an AI to do, and the unspoken assumptions about how you want the AI to do it. We propose a new metric: the Genie coefficient.