[falcor84]

While ReLU is relatively new, AI researchers have been aware of the need for nonlinear activation functions and building multilayer perceptrons with them since the late 1960s, so I had assumed that's what you meant.

[xanderlewis]

It was a deliberately historical example.