[kkylin]

When I worked in the AI Lab as an undergrad, it was clear even to the advocates of GOFAI that the systems were brittle and only worked in special cases. Nevertheless the work went on, in part because we always learned something about what made these problems (e.g., image classification) hard for rule-based systems even though humans seem to solve them effortlessly. (I suppose cool tech sometimes emerged from these efforts that had nothing directly to do with the task at hand, and that's another partial justification.)

Now we have systems that are starting to catch up to and in some cases surpass human performance, and yet we (or at least I) have a hard time articulating what it is we learn about these types of problems from current statistical AI. I sometimes feel there is some kind of uncertainty principle at work here.