[chongli]

if you take a human at say classification task, they'd be able to explain why they identify bicycle as bicycle and not, say, bulldozer.

I don't think this is such an easy task. In the professional world of scientific taxonomy there are many problems with classification. The problem seems to stem from the tension between intensional and extensional definitions.

[varjag]

Yes but you still are able to verbalize these problems, quite unlike when you stuck with a misfiring ANN. In symbolic approaches, e.g. inference engines, you have comparable explanatory facilities.