[trhway]

>Second the fruit-fly brain has 25,000 neurons while the human brain has more than 10,000,000,000. There's 6 orders of magnitude difference there.

>Lastly the connectivity of neurons in the human brain is very high.

yep, the human brain is 100B neurons and has 10e4 connections per neuron while the fly brain has 10e3 connections/neuron. So we need to emulate 10e15 connections of the human brain. GPT-3 has 175B of weights.

[aeternum]

Right, but GPT-2 had 1.5 billion neurons in 2019 so GPT-3 was a 100x increase. 1e15 may not be that far off, especially since these operations are relatively straightforward to run in parallel.