To me 'demystifying' really means making simpler to understand. Yours sounds like technical pedantry, that while true (idk?) is meaningless to anyone who actual needs a neural net demystified.
Um, no. Show an electrical engineer the circuit diagram of an 8-bit added and they'll know the function right away. The function of the NN is similarly determined by the topological circuitry--in fact the function can often be preserved when you represent these networks as Boolean network, but all that's concealed when we don't remove spurious connections and it starts to feel like weird voodoo mathemagic. This is not an opinion, I've published on this and have seen scientist get confused because of it.