Hacker News new | ask | show | jobs
by sentientmachine 4351 days ago
"Can you, at the same time, read this sentence and think about yourself reading it?"

The moments before I fall asleep is when I sometimes can get a glimpse of how the machinery of reading and thought work under the hood. It looks like a computer program that runs thousands of commands in parallel, and it's not controlled by the command-giver between your ears.

There is a shutdown process that occurs when you fall asleep, to most people it's like a switch where it goes from totally on to totally off, but I've come to see it like a janitor walking from room to room in a large building and flicking off lights in each room one after another.

And you can change the order of the shutdown procedure to keep the command-giver in your mind awake until last, and watch what happens that requires your thinking mind to go away while it brings up new processes. The most fascinating part is those 4 seconds before falling asleep. Where you get the halting of ordinary thought, and the machinery that does deep learning rumbles to life one by one, in various order.

It's hard to describe, one thing I see, it all operates in parallel. And it's like a democracy. It's not a line of execution, it's everything all at once. All experiences being dumped into modified networks to solve for objectives. If a superior model is found to map input to motor output, the new model is made dominant. We do learning during the day, but the model generation that glues it all together happens at night. And you can watch it do its work in those moments before sleep.

1 comments

Interesting... sounds similar to what Feynman did.