Hacker News new | ask | show | jobs
by seri4l 636 days ago
>We can say a lot of things about what may happen next, but the main one is that AI is going to get better with scale.

Could anyone elaborate on this? Further down he talks about the necessity of bringing the cost of computing down. Is that really the bottleneck?
2 comments
kneel 636 days ago
Few short learning performance scales with model size. Afaik they don't see a plateau yet and the race is on the ingest more data and come up with better tuning techniques.

https://splab.sdu.edu.cn/GPT3.pdf

link
ks2048 636 days ago
"AI is going to get better with scale" to me says almost nothing at all. It includes anything from we 100x the scale and get 1% improvement to 2x the scale and get "AGI".
link