Hacker News new | ask | show | jobs
by stayfrosty420 1663 days ago
Seems like a distinct issue to me, though there are obvious parellels and similar outcomes.
2 comments

Because AIs are relatively narrowly focused, they suffer greatly from limited data sets. More often than not, an AI will simply memorize test data rather than "learning".

This impacts the benchmarking process, so I think it's relevant.

Hey, you're giving away my secret for passing AWS certification exams!
Agree, I was not saying it was redundant. But I would have expected a reference, as that paper was the first related item that came to my mind.