[msgodel]

This is part of why I really like local models. I always use the same random seed with mine so unless I'm using aider the responses are 100% deterministic. I can actually hit c-r in my shell to reproduce them without having to do anything special.

[muzani]

Some are more deterministic than others, e.g. Gemini Flash.

[msgodel]

The non-determinism comes from the sampler not the model.

[muzani]

I always thought it was packaged with the model.