[f6v]

It’s difficult to comprehend impact of something that’s widely adopted. Like, batch normalization alone was probably mind blowing when it came out. Yet it seems so simple and self-explanatory now.

[imtringued]

Or residual connections. It is just addition.