[moconnor]

An exaflop of mixed-precision compute for $250M over 3 years. That’s ballpark what the HPC community is paying for their exaflop-class machines.

You’d still build your own for that money, I think, but it’s an interesting datapoint.

[dx034]

How long if you build it your own incl electricity prices? If margins are similar to other EC2 instances, you'd probably break-even after 6 months or so. Which makes EC2 uneconomical for any lab/company that can utilise the cluster 24/7.

Still nice if you quickly need to get some model results though.

[laumars]

Amazon prices are for the pay as you go model. You can shave a significant amount off the price if you know you're going to be running them for 12 months.

[dexterdog]

And even less if it's 36 months.

[dharma1]

If you're going to be running it for 24x7 for 3 years, I think it'd be worth doing the apples-to-apples comparison of buying your own V100s vs renting them from AWS. The DGX Station with 4 V100s is $70k

[dexterdog]

It wouldn't be $250K over 3 years. It would be $250K up-front to get the lowest current pricing.