[eru]

It's not just being sure exactly what the hardware is, in demos you have the additional luxury of not being interactive. So you can plan everything exactly out in advance.

[saagarjha]

This is true of inference too.