Hacker News new | ask | show | jobs
by zorked 1196 days ago
The simple fact that a LLM is trained on a gigantic corpus of data and humans learn from a relatively tiny number of interactions with other humans shows that they obviously learn differently.
3 comments

>humans learn from a relatively tiny number of interactions with other humans

but those interactions are infinitely complex and contain an enormous amount of data

And children are really stupid until they have been exposed to even larger amount of data.
If we took all of the data that a human takes in from all of their senses, I'm not sure if humans use less data.

Humans take in 10 million bits[1] from their eyes every second. 10,000,000 bits/sec * 60 secs/min * 60 mins/hour * 24 hours/day * 1000 days = 108 terabytes. ChatGPT only used 570 GB of training data, so 2 orders of magnitude less data, and that's only counting the visual data.

edit: And that would be for a 3 year old, so comparing ChatGPT's intelligence to a 3 year old shows that ChatGPT comes out favourably.

[1]https://www.sciencedaily.com/releases/2006/07/060726180933.h....

Or that brains have more processing power or a subtly different architecture than current LLMs