[diggan]

It would be cool if something like vast.ai's "DLPerf" would become popular enough for the hardware producers to start using it too.

> DLPerf (Deep Learning Performance) - is our own scoring function. It is an approximate estimate of performance for typical deep learning tasks. Currently, DLPerf predicts performance well in terms of iters/second for a few common tasks such as training ResNet50 CNNs. For example, on these tasks, a V100 instance with a DLPerf score of 21 is roughly ~2x faster than a 1080Ti with a DLPerf of 10. [...] Although far from perfect, DLPerf is more useful for predicting performance than TFLops for most tasks.

https://vast.ai/faq#dlperf

[az226]

We don’t need this. We can easily unpack Nvidia’s marketing bullshit.

5090 is 26% higher flops than 4090, at 28% higher power draw, and 25% higher price.