Hacker News new | ask | show | jobs
by heresjohnny 1138 days ago
Unless efficiency is significantly improved, I don’t see how community incentives (with community resources) could train a model with that many parameters. Would love it if it happened, though. That would be true Open AI.
2 comments

We are seeing both improved efficiencies and smaller models getting better. The pace of improvements is unreal. I would expect in the next few years we will have something on par and open source.
Absolutely!