[mydriasis]

> Distributing a single model over thousands of tiny GPUs takes months of time from dozens of people with rare expertise. CG-1 eliminates this challenge. Setting up a generative AI model takes minutes, not months and can be done by a single person.

That's fascinating. Their website[0] says that their model support is 600 billion parameters. Is that enough, given how rapidly these models seem to be expanding? I'm not on the up-and-up with how vast they need to be.

[0] https://www.condorgalaxy.ai/

[cs-fan-101]

[Cerebras employee here] Condor Galaxy 1 can support beyond 600 billion parameters. In standard config its 600B but it can scale to train upwards of 100T parameter models

[mydriasis]

Wow, that's a lot! Awesome info. Thank you!