|
|
|
|
|
by gwern
1591 days ago
|
|
Density is also important. If we look at other things - some recent studies have been done on number-counting (https://royalsocietypublishing.org/doi/10.1098/rstb.2020.052...) or bird brains (https://www.gwern.net/docs/psychology/neuroscience/2020-herc...) - density jumps out as a major predictor. African elephants may have some more neurons, but the density isn't as great as a human where it counts, so they are remarkably intelligent (like ravens and crows), but still not human-level. There are diminishing returns in both directions. We have more neurons than any bird as much or more dense, and we have more density than any elephant with as many or more neurons. Put that together, and we squeak across the finish line to being just smart enough to create civilization. An analogy: what's the difference between a supercomputer, and the same number of CPUs scattered across a few datacenters? It's that in a supercomputer, those CPUs are packed physically as close as possible with expensive interconnects to allow them to communicate as fast as possible. (For many applications, the supercomputer will finish long before the spread out nodes ever finish communicating and idling.) But you need to improve both or else your new super-fast CPUs will spend all their time waiting on Infiniband to chug through, or your fancy new Infiniband will be underutilized and you should've bought more CPUs. |
|