[clhodapp]

Models don't even agree with themselves in terms of returning identical results

[tracerbulletx]

Yes they do. Sampling is the only pseudo-random part. Models return a deterministic distribution of output tokens for a given input of tokens.