[Davidzheng]

Wikipedia says 100 billion neurons in the brain

[riku_iki]

Ok, I messed up, we need compare LLM weight with synaps, not neuron, and wiki says there are 100-500T synapses in human brain

[Davidzheng]

Ok let's say 500T. Rumor is currently gpt4 is 1T. Do you expect gpt6 to be less than 500T? Non sarcastic question. I would lean no.

[riku_iki]

So, they may trained gpt4 with 10B fundings, than for 500T model they would need 5T fundings.