Any chance of seeing a photo of you in guymode that it recognises as being in guymode?
In its defence, you do look very different in those photos. I wouldn't recognise you as the same person. That said, I'm surprised that it ranked you so poorly in the first photo.
Here are the ones I used: http://imgur.com/a/yFwN4 -- the first one was taken today, the rest are all from the last couple of months.