The marginal cost of each chip is dollars. The 5 digit prices for H100s are just margins to be undercut
You can (and I think should), cut it out by going with coreweave, lambda, another or doing it yourself
I’m okay paying that huge margin to first tier cloud for CPUs and disks, which are cheap, but not GPUs
You can (and I think should), cut it out by going with coreweave, lambda, another or doing it yourself
I’m okay paying that huge margin to first tier cloud for CPUs and disks, which are cheap, but not GPUs