[throwqwerty]

Looks like a good summary. Will read. But at the rate the discipline moves I feel like we need one of these every couple of months for everyone (not just "lay" scientists). Anyone know a good journal or something that produces a similar sort of survey frequently? Like once a quarter?

[ssivark]

“Rate at which the discipline moves” is mostly churn, not progress. Important insights come at a slower rate — at the speed of human understanding, not at the speed of conference papers. Good papers from even decades ago are likely to still be useful — in fact, they will have the key ideas presented simply and clearly, without much jargon or hype. Yes, deep learning practice moves quite fast these days, but that’s just the veneer on top of those deeper ideas, trying out tweaks and variations. That’s not completely an indictment of deep learning, rather, any nascent field has a lot of confusing bustle.