Google has the most big pre-trained models while Alibaba has the largest

Y	Hacker News new \| ask \| show \| jobs

	Google has the most big pre-trained models while Alibaba has the largest (openbmb.github.io)
	4 points by fishingboy 1390 days ago

1 comments

IceMetalPunk 1390 days ago

So the number of parameters metric here is the sum across all their models, right? There isn't yet a single model with 10 trillion parameters... right?

link

fishingboy 1390 days ago

Yes, it is the sum of all models. But M6-10T (MoE) of Alibaba is a 10 trillion one.

link