[jedberg]

It asked me to draw a tree. I drew a palm tree. It said "palm tree" on the bottom, but then said it failed.

I drew the palm tree because I've studied AI and that's a classic AI mistake.

If you go to Hawaii and ask students to draw a tree, almost all of them will draw a palm tree. Ask them to draw a bird and it looks like a parrot (instead of the robin you see typically in the "lower 48").

It's interesting that this seems to suffer from the same selection bias.

[ythn]

It seems biased. When it said draw the moon, I drew a circle with a smaller crater shaped circle inside it, and it immediately guessed "the moon". Later when it asked me to draw a cookie, I drew the same exact shape (circle with smaller circle) and it immediately guessed cookie, not moon. What's going on?

[halfdanj]

The classifier is returning a set of confidence scores, so if the shape you drew probably had a high confidence of both cookie and moon. (in fact if you draw it, and click on it in the endgame screen you can see some details what it saw in the image). We are not hinting the classifier what your task is, so we try not to bias the classifier. Jonas (developer behind quick draw)

[Florin_Andrei]

Sounds like that drawing satisfies both criteria. (shrug)

[ythn]

So it's not really "guessing", it's just seeing if my drawing matches a predetermined bank of answers? Makes sense, since one time it asked me to draw a "police car" and before I had even finished drawing the chassis of a normal car it had already guessed "police car" and moved on.

[Meegul]

It's probably assigning a number of possibilities with a confidence rating, and as soon as the confidence rating is > than some percentage of what it's asking you to draw, it says it.

[eyqs]

I'd say it's "guessing" from a predetermined (rather small) bank of answers, since the same guesses appear over and over again.

[halfdanj]

it's correct that we have "only" trained it on a couple of hundreds of classes, so it will only guess from that dataset.

[yummyfajitas]

As an amusing side note, whether or not a coconut palm (and presumably regular palms also) qualifies as a tree is a pretty controversial topic in Goa.

http://timesofindia.indiatimes.com/city/goa/Coconut-tree-los...

[JaumeGreen]

It also fails when people have been giving it wrong data.

I had to draw an aircraft transport, I draw a reasonable one. What it was expecting, instead, was a plane, As most people just drew that.

[Symmetry]

And of course humans suffer from that too, in a much more sophisticated way.

http://lesswrong.com/lw/nk/typicality_and_asymmetrical_simil...

[nl]

Yes, and this is an interesting way to get more labelled data.