|
|
|
|
|
by ACCount37
14 days ago
|
|
Do you think your brain doesn't do a type of gradient descent, trying to fit its little predictive algorithms to its senses? Do you think you aren't a fancy probability machine with overinflated self-esteem? An average LLM of today has better reading comprehension than an average human, and the gap only grows release to release. "Understand the human mind" turned out to be a distractor. The bitter lesson won: you can take a "good enough" AI architecture, burn a shitton of data into it with an unholy amount of training compute, and get halfway to AGI - no "understand the brain" required. LLMs are so fried in imitation learning on human-generated data they even inherit humanlike failure modes. |
|