| Cheap. Fast. Good. Pick two. Colossus is the world's largest single, unified GPU cluster, all GPUs acting as one coherent supercomputer rather than fragmented pools or multi-site setups. They spun it up in a fraction of the time by all estimates. It's not something you can just throw money at and reproduce the results. Per Jensen Huang: "As far as I know, there's only one person in the world who could do that; Elon is singular in his understanding of engineering and construction and large systems and marshaling resources; it's just unbelievable. A supercomputer that you would build would take normally three years to plan and then they deliver the equipment and it takes one year to get it all working." ..."it took 19 days to get Colossus from hardware installation to beginning training, the fastest by far anyone's been able to do that." https://www.businessinsider.com/jensen-huang-elon-musk-super... Regarding on site generators. Meta, OpenAI (Microsoft/Oracle) and others are also using on-site gas turbines, generators, and "behind-the-meter" power plants to keep up with the power demand. This has become an industry-wide strategy driven by grid constraints, with natural gas as a fast-deploy option. It would be great if the grids could keep up with demand, if other options would be considered capable of producing the ongoing demands (ie. more renewable, nuclear, etc) but they're not, and companies are not going to just wait because then they're as good as done. |