[greeneggs]

Yudkowski argues that on the scale of intelligence, Einstein and a village idiot are basically right next to each other [1]. So once artificial intelligence gets close to matching the village idiot, it is not far from completely thrashing Einstein.

Now if that same picture held for Go, then a situation like this would seem to be impossible. Either the computer should be much worse than a human player, or much better. It would be an incredible coincidence that, at the end of six months of training, the computer happened to be of comparable skill to humans.

For the game of Go, at least, Yudkowski is wrong. What other aspects of intelligence are this way? Yudkowski's picture seems appealing, but perhaps it is wrong for many areas of intelligence.

[1] http://lesswrong.com/lw/ql/my_childhood_role_model/

[froogle]

AlphaGo is not an AI in the sense meant by Yudkowsky, I believe. He speaks more of a recursively self-improving AI, an AI which is capable of upgrading itself to be faster and more intelligent.

In the linked article, Yudkowsky even says "On the right side of the scale, you would find Deep Thought—Douglas Adams's original version, thank you, not the chessplayer." The implication is clear that these programs playing chess/Go are nothing like what he is talking about - general AI.

Or so I assume, from my less-than-complete understanding of Yudkowsky's writings.

[mcv]

Only if there's actual room to be much better. It's quite possible that 9p players are already pretty close to perfect play. Maybe a computer can get slightly closer still to that perfect play, but it's never going to be better than perfect play. There's not always room for improvement.

[meric]

>> It would be an incredible coincidence that, at the end of six months of training, the computer happened to be of comparable skill to humans.

I don't think it's that incredible - By 18 years old a significant proportion of high school students know more about chemistry than the best scientists up to 1800 did, combined.

There's a lot of human games for AlphaGo to look at, but if it is to exceed human level of play, it'll have to figure how to do that by itself. Look at human level games, learn to play human level.

It's quick to get to the edge of human knowledge, and slower to go beyond it.