[zipppy]

I agree and believe that it's pre-programmed in some ways. I took the test twice, and in the first set I had 'zigzag' and in the second set I had 'stairs'.

I drew the exact same doodle for each and for each it guessed correctly on its first try.

[OJFord]

No, I believe it makes a series of guesses ranked for 'closeness'.

If what you're supposed to be drawing is ranked 'sufficiently high' the game/training side of it moves on to the next.

[zipppy]

What? My point is that I drew the same doodle for different words, and for each word it put forth a different _first_ guess.

The first guess for each doodle was the word that was provided -- if this software was completely legitimate, I would think it should have guessed the same word for each (and then moved on to other guesses).

[simias]

They weren't really the same though, right? Only similar.

A good test for that would be to script the game and give it pixel-identical answers for each questions and see if the result is different.

[zipppy]

Correct that they were not identical, but they were quite close; five lines that looked like a 'w'.

[simias]

FWIW it guessed my lightning correctly (a simple `z` like shape). Its 2nd guess was "zig-zag" and the 3rd one "star" for some reason. So it really looks like for this network a zig-zag and a star are more similar than I would've guessed.

I guess a star is a zig zag looping on itself, kinda.

[mthoms]

I wonder if the zig-zag drawing and the stairs were actually as similar as you remember.

For instance, our sub-conscious tendency when drawing stairs would be to have straight lines at 0 and 90 degrees but a "zig-zag" wouldn't necessarily have that feature. Thus, even though you thought the drawings were the same, there were sufficient detectable differences for the AI to recognize.