[minimaxir]

Softmax just normalizes the logit outputs to be positive and sum to 1.0, it doesn't have an effect on determinism.

[schoen]

Thanks, I guess I confused its role with the adjacent step!