[hakunin]

It helps, but it doesn't make it deterministic. LLMs could all be misled together. A different story would be if we had deterministic models, where the exact same input always results in the exact same output. I'm not sure why we don't try this tbh.

[verdverm]

I've been wondering if there are better random seeds, like how there are people who hunt for good seeds in Minecraft

[exe34]

it's literally just setting T=0. except they are not as creative then. they don't explore alternative ideas from the mean.

[hakunin]

Are you sure that it’s T=0. My comment’s first draft said “it can’t just be setting temp to zero can it?” But I felt like T is not enough. Try running the same prompt in new sessions with T=0, like “write a poem”. Will it produce the same poem each time? (I’m not where I can try it currently).