Hacker News new | ask | show | jobs
by TwoFerMaggie 504 days ago
This reminds of the joke in physics, in which theoretical particle physicists told experimental physicists, over and over again, "trust me bro, standard model will be proved at 10x eV, we just need a bigger collider bro" after another world's biggest collider is built.

Wondering if we are in a similar position with "trust me bro AGI will be achieved with 10x more GPUs".
1 comments
vonneumannstan 504 days ago
The difference is the AI researchers have clear plots showing capabilities scaling with GPUs and there's not a sign that it is flattening so they actually have a case for saying that AGI is possible at N GPUs.
link
segasaturn 504 days ago
Sauce? How do you even measure "capabilities" in that regard, just writing answers to standard tests? Because being able to ace a test doesn't mean it's AGI, it means its good at taking standard tests.
link
vonneumannstan 504 days ago
This is the canonical paper. Nothing I've seen seems to indicate the curves are flattening, you can ask "scaling what" but the trend is clear.

https://arxiv.org/pdf/2001.08361

link