[rowanG077]

The point is that from a black box view they are rapidly surpassing humans in a lot of fields. You can say they do it with tools the human mind has no access to. That's probably true. The "soft effusive human way" to be intelligent is also black box, and something we aren't even close to understanding. This means it's as close to be able to be measured as string theory. "If it's not exactly like this thing we don't understand it's not fair".

[chongli]

They're not a black box though. They're querying an external resource (Google Search). That's crossing an API boundary. If you're going to let them use Google Search then let the human opponent use Google Search as well.

It's like if you were building an AI robot to run a marathon against a human opponent, except you let the AI robot ride a motorcycle and force the human to stay on foot.

[SamPatt]

Search was irrelevant in this case. I ran it again without search and it made the same guesses. I updated the post with those details.

[rowanG077]

I didn't say the AI is black box, I said if you take a black box view. That last word is load bearing.

Did you read the article? It's clearly shown that with or without search it doesn't make much of a difference how good it actually is.