|
|
|
|
|
by jonathanlei
489 days ago
|
|
It's as difficult as a serverless provider to grow as it was for CPUs before GPUs came along. Many companies overinvest in fully-owned hardware, rather than renting from clouds. Owning hardware means you underwrite unrented inventory costs and prevents you from scaling. H100 pricing is now lower than any self-hosted option, even without factoring the TCO & headcount. (Disclaimer: I work at a GPU cloud Voltage Park -- with 24k H100s as low as $2.25/hr [0] -- but Fly.io is not the only one I've noticed purchase hardware when renting might have saved some $$$) [0] https://dashboard.voltagepark.com/ |
|