[gryphonshafer]

> Achieving human-level performance on any real-world task is an exceedingly difficult endeavor when moving away from a few simple and well-defined tasks.

It's an exceedingly difficult endeavor to try to get all humans to produce "human-level performance" while doing simple and well-defined tasks. Evidence = Mechanical Turk.

[50CNT]

An interesting thing to note there is that research shows that untrained individuals have significant variance in task performance which decreases as they get better at the task. Mechanical Turk might be an extreme case, since all tasks are done by untrained individuals.

Whilst I agree with the quote that AI has difficulties when moving away from well-defined tasks, so do we. Most expert performance is constricted to narrow task domains, does not transfer well to other domains, and takes a long time to acquire. In a sense, that's not too dissimilar to AI.

I do disagree with the "simple". Games such as Chess are the stereotypical example for things AI performs well in. Their rulesets are well defined, but the games are incredibly complex. It is amazing that AI outperforms even grandmasters in this area.