| I formally studied biology not CS, partly out of an interest in AI. Everyone who thinks superintelligence or even just human or higher-animal level intelligence is right around the corner needs to study genomics, proteomics, molecular biology, and neuroscience. Study them with an open mind and think about what's really going on. A neuron is not a switch. A neuron is an organism. It contains a gene regulatory network more complex than the entire network topology of Amazon's entire web services stack, and that's just looking at the aspects of gene regulation and enzyme (a.k.a. nanomachine) operation that we understand. There are about 100 billion of these in the brain and every one of them is running in parallel and communicating constantly. There are also about 10 glial cells for every one neuron, and glia are involved in neural computation in ways we know are there but don't yet fully understand. (Seems to be related to longer term regulation of synapse behavior, etc.) Each glial cell also contains a massive gene regulatory network and so on. The CS and AI fields suffer from a lot of Dunning-Kreuger effect when they talk about biology. The level of processing power and the parallelism that's going on in the brain of a living thing is simply mind numbing. It's as incredible as the sense you get of the scale of the universe when looking at the Hubble Deep Field. Our present-day computers are toys. We are not even close. It would at least take advances equivalent to the ones that took us from vacuum tube ENIAC to here. Edit: I don't write off superintelligence categorically though. I think we could achieve forms of it not through pure AI but by deeply augmenting biological intelligence. Genetic and biochemical performance enhancement could also play a role. Imagine having more working memory, perfect motivational control, the ability to regulate your own desire/motivational structure, and needing only a few hours of sleep. Cyborg superintelligence is a possibility in the foreseeable future and it does raise issues similar to those the superintelligence folks raise. So I don't dismiss an intelligence explosion. I just very strongly doubt it would be purely solid state. |
I'm sure this is right, but what about the reverse -- how much do you know about AI?
AI need not be as complex as natural intelligence to be more intelligent. A lot of the complexity in the natural world is due to the blind and haphazard nature of engineering by natural selection. Do we understand, completely, at a molecular level, the physical and control systems of bird and insect flight? Or how fish swim? Probably not. But by understand the principles and applying a certain amount of engineering brute-force, we've produced machines that by many sensible measures out-fly and out-swim natural machines.