[chongli]

They're not a black box though. They're querying an external resource (Google Search). That's crossing an API boundary. If you're going to let them use Google Search then let the human opponent use Google Search as well.

It's like if you were building an AI robot to run a marathon against a human opponent, except you let the AI robot ride a motorcycle and force the human to stay on foot.

[SamPatt]

Search was irrelevant in this case. I ran it again without search and it made the same guesses. I updated the post with those details.

[rowanG077]

I didn't say the AI is black box, I said if you take a black box view. That last word is load bearing.

Did you read the article? It's clearly shown that with or without search it doesn't make much of a difference how good it actually is.