[xwdv]

We can do it for way less using spot instances on AWS, though it takes longer.

[WatchDog]

AWS don't have any GPU spot instances right?

I highly doubt you could get anywhere near the same price.

[WatchDog]

Very very rough estimate, using inference benchmarks, which can't necessarily be extrapolated to training, but if a A100 takes 6.49 seconds to generate an image, and a EPYC 7352 24-core cpu takes 223.19 seconds[0], that's 34 times slower.

So you would need at least 2,716,796 hours to train on CPU.

A m6a.12xlarge is roughly equivalent to a EPYC 7352 24-core[1], it currently costs $0.5028 an hour on spot.

So that works out to a cost of $1,366,005.

[0]: https://lambdalabs.com/blog/inference-benchmark-stable-diffu...

[1]: https://browser.geekbench.com/v5/cpu/compare/17529628?baseli...