[deepsquirrelnet]

This is uninteresting. The token logits from the model output are deterministic, while the sampler can be made to simulate probabilistic responses by adding randomization to the token selection (using a deterministic probability distribution). For repeated measurements, unless you have a high amount of randomization in your sampler, you should not expect different answers.

Generate a random seed and write it into your prompt (new seed each prompt). I bet dollars to donuts you’ll get different results.