[vrganj]

> Struggle to build a competitive 1T model (Grok 4.5) with massively more compute (Colossus-1 100-250K GPUs, Colossus-2 500K+ GPUs).

This feels like a very American way of designing things - just throw more horse power at it, bigger is better! The rest of the world is usually a bit more resource constrained and efficient at using those resources.

See also Mustangs vs German sports cars, giant American fridges, giant American suburban McMansions vs livable cities etc etc.

[conover]

This is the bitter lesson: https://en.wikipedia.org/wiki/Bitter_lesson

[HarHarVeryFunny]

You've just got fridge jealousy! ;-)

[locknitpicker]

> This feels like a very American way of designing things - just throw more horse power at it, bigger is better!

I don't think so. Bruteforcing problems is a well established strategy in any field that involves computation of any form. Once you get something working, you can get results right now if you throw resources at it. In the meantime, any improvement in efficiency can easily be back ported to the same computational resources you're using.