[kubb]

You will need 100s of billions to make a viable POC.

[dgellow]

For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude

[kubb]

Let's wait 10 years and see.

[RHSman2]

In 10 years the world will not be the same.

[AlexCoventry]

You only need to train a range of small models in order to establish a plausible scaling law, IMO.