[homarp]

https://twitter.com/emostaque/status/1563870674111832066 says "We actually used 256 A100s for this per the model card, 150k hours in total so at market price $600k"

[godmode2019]

But they still have those A100s?

I think you have to compare it to how much ETH you could have mined as the opportunity cost of training a model vs other uses of a GPU

[l33tman]

I think it was donated by AWS or something. This is not a scenario where it makes sense to buy and maintain your own server park of GPUs, when there is a race to the bottom already with cloud-based GPU rentals.

[homarp]

Also compare the impact of releasing Stable Diffusion vs 'yet another coin'/web3 announcement.

[homarp]

https://www.forbes.com/sites/kenrickcai/2022/09/07/stability...