[jayajay]

Makes sense. Out of all of the permutations of functions, I see no reason why using the same function at every node would lead to an optimized network.

I really commend the ML people out there that have developed an intuition for network architecture and which functions to use... If there's a Feynman for machine-learning, I wanna listen to some of his lectures.