[dist-epoch]

Desktop CPUs have integrated GPUs, so it's more complicated. If I infer on the GPU inside my CPU, how do you count that?

[rerx]

True. Memory bandwidth may be the most limiting factor.