Hacker News new | ask | show | jobs
by csomar 73 days ago
My point is, your inference process is the non-deterministic part; not the model itself.
1 comments

Eh., if you have a PyTorch model that uses non-deterministic tensor operations like matrix multiplications, I think it is fair to call the model non-deterministic, since the matmul is not guaranteed to be deterministic - the non determinism of a matmul isn't a bug but a feature.

See e.g.https://discuss.pytorch.org/t/why-is-torch-mm-non-determinis...