Hacker News new | ask | show | jobs
by bufferoverflow 1771 days ago
It probably can scale, but we're nowhere near the computational power we need to even recreate the brain. And don't forget, our brain took a billion years to evolve.

A typical brain has 80-90 billion neurons and 125 trillion synapses. That's a big freaking network to train.

Hopefully we can figure out how to train parts of it and then assemble something very smart.

1 comments

Takes on average 2.5 decades to train it.
That's just from the most recent checkpoint :-)

If you were to build it "from scratch" you'd also need to include the millions of years of (distributed) evolution required to get that particular kid to that point.

Tony Zador has some interesting thoughts about that, including"A critique of pure learning", here: https://www.nature.com/articles/s41467-019-11786-6)