| The caption for the top graph appears a bit out of whack. It states "exponential decline in top 5 error rate", the decline looks more like diminishing returns to me, especially if you push the 2017 data point out to where it should be (they've omitted 2016). It's nice that the error rate is low, but the caption appears to oversell it. This graph reminds me of a very closely related one I saw in a talk a few years ago [1]. It was showing decline in voice recognition error rates over time, with a highlighted band for "human performance". The speaker, Roger Moore (the academic, not the actor, and not the Moore with the law), pointed out that this line, while encouraging, hid two important points. 1) For linear improvement, exponentially more training data was needed.
2) No insight into how living beings solve the same task. These aren't necessarily fatal flaws, but they're worth remembering. [1] https://www.youtube.com/watch?v=iYbVsvxd3bE |