Hacker News new | ask | show | jobs
by WatchDog 1241 days ago
Very very rough estimate, using inference benchmarks, which can't necessarily be extrapolated to training, but if a A100 takes 6.49 seconds to generate an image, and a EPYC 7352 24-core cpu takes 223.19 seconds[0], that's 34 times slower.

So you would need at least 2,716,796 hours to train on CPU.

A m6a.12xlarge is roughly equivalent to a EPYC 7352 24-core[1], it currently costs $0.5028 an hour on spot.

So that works out to a cost of $1,366,005.

[0]: https://lambdalabs.com/blog/inference-benchmark-stable-diffu...

[1]: https://browser.geekbench.com/v5/cpu/compare/17529628?baseli...