Hacker News new | ask | show | jobs
by nmca 1769 days ago
12B, though. What about 1.2T?
1 comments
lstmemery 1769 days ago
You need to scale the amount of data to take advantage of the increase in parameters. I'm not sure where we would find another 100 GitHubs worth of data.
link