[TZubiri]

Pretty sure this is wrong, requests are batched and size can affect the output, also gpus are highly parallel, there can be many race conditions.

[TeMPOraL]

Yup. Floating point math turns race conditions into numerical errors, reintroducing non-determinism regardless of inputs used.