[PaulHoule]

Does this take into account the fact that you might need fewer epochs if you reduce the batch size? (as is done for the CPU?)

[elmarhaussmann]

Author here.

No, this is really only comparing the throughput on the devices. A thorough comparison should really focus on time to reach a certain quality - including all of the tricks available for a certain architecture.