[mensetmanusman]

Neural networks do have a memory of sorts, that’s why they improve with node size. A mathematician proved something along these lines recently.

The memory isn’t digital bits like we think of now though, but abstractions in higher dimensions.