[charlesischuck]

A top end gpu now to make you competitive cost 20-50k per gpu.

To train a top model you need hundreds of them in a very advanced datacenter.

You can't just plug gpus into standard systems and train, everything is custom.

The technical talent required for these systems is rare to say the least. The technical talent to make a model is also rare.

I trained a few foundation models with images, and I would NEVER buy any of them. These guys are on a wildly different scale than basically everyone.