Hacker News new | ask | show | jobs
by TeMPOraL 858 days ago
Large ML models tend to be uncorrectably non-deterministic simply from doing lots of floating point math in parallel. Addition and multiplication of floats is neither commutative nor associative - you may get different results depending on the order in which you add/multiply numbers.
1 comments

Addition and multiplication of floats are commutative.