[jorleif]

Having done a little science myself, usually there both are small incremental improvements with small but predictable gains and large leaps with big potential gains but very unpredictable outcomes. The former are optimizations around a current local optimum, and the latter try to escape it towards a better local optimum. For that reason the incremental gains tend to saturate over time, and I suspect that is what Goodenough is dismissing.