[CamperBob2]

Good point. I know there are people working on optical NNs, but I have no idea how they handle nonlinear activation functions.

[Q6T46nT668w6i3m]

There’re a handful of ways to introduce electro-optical and all-optical non-linearities into optical neural networks. Here’s a fair survey of the field: https://dl.acm.org/doi/full/10.1145/3607533