Hacker News new | ask | show | jobs
by red75prime 11 days ago
> There is also an epistemological assumption that prevails, and that is that we understand (or we think we understand) how our brain/mind works.

It's good that it doesn't matter. Stochastic gradient descent works (or doesn't work) regardless of whether we know how the brain does its thing.

1 comments

we know the brain does not use gradient descent. (i agree it doesn't matter)
How do we know this?
i recall a hinton lecture where he talks about the mechanism of memory formation in the brain and it's not fully sussed out but it's also not backprop, its some sort of forward prediction and immediate reinforcement loop.

There's also no plausible biological/chemical mechanism to backpropagate.