[dudus]

I know AWS/GCP/Azure have overhead and I understand why so many companies choose to go bare metal on their ops. I personally rarely think it's worth the time and effort, but I get that with scale saving can be substantial.

But for AI training? If the public cloud isn't competitive even for bursty AI training, their margins are much higher than I anticipated.

OP mentions 10-20x cost reduction? Compared to what? AWS?

[jerjerjer]

AWS offers p5.48xlarge which is 8xH100 for $98.32, so 12.29$ per hour per H100 - ~6x the price.