Hacker News new | ask | show | jobs
by leptons 101 days ago
>OpenAI seems to believe more and larger datacenters is the path to better models...

Does that mean they produce better slop, or more slop faster?
1 comments
allreduce 101 days ago
Better slop. The effect that these systems get better as you scale up [0] is real you know.

[0]: https://arxiv.org/pdf/2001.08361

link
leptons 101 days ago
Slop is still slop. There is no legitimate evidence that these systems get any better just by throwing more hardware at it. Every one of the people in this paper is involved with OpenAI, so it is very suspect in its findings.
link