Hacker News new | ask | show | jobs
by j_bum 680 days ago
Assuming that GPT4 has 1T+ parameters, you’re incorrect.

Modern estimates are that there are 100T neuronal connections in the adult human brain [0]. And that’s neuronal connections alone.

Astrocytes also make direct connections with neurons and can modify and induce neuronal activity [1]. There are 100B neurons [0] and ~20B astrocytes in the adult human brain [2, 3].

So this 100T connections estimate is only a small slice of the picture of human brain activity.

[0] https://medicine.yale.edu/lab/colon_ramos/overview/#:~:text=....

[1] https://neuraldevelopment.biomedcentral.com/articles/10.1186....

[2] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5063692/

[3] https://link.springer.com/article/10.1007/s00429-017-1383-5

2 comments

I was basing my number on Wolfram's work here: https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...

"In human brains there are about 100 billion neurons (nerve cells), each capable of producing an electrical pulse up to perhaps a thousand times a second."

So maybe that's wrong. Thanks for the links. Even so if we look out 10, 100, 200 years from now, that level of complexity will be greatly surpassed by AI.

Indeed, the computing power of cells is nothing to blink at.

It is astonishing that we can mimic human reasoning so well with these LLMs, but the essence of cognition seems to still be missing.

I agree with your belief that human processing will be surpassed in the future. We do live in some exciting times :)

Speed relative to environment is important in determining if something is intelligent. If it takes N flops to produce one token but I carry those out in 10 years, that is not intelligence.
The machines will be much faster than us, and soon. So what's your point?
Consciousness or at least intelligent behaviour is how fast a system is relative to environment.