[gkoberger]

It's not a random seed, but it will always be slightly different. It's similar to "prompting" a human... you'll likely get the same general result if you ask the same person the same question a dozen times, but it will have enough variability that it won't be identical.

[thefreeman]

Pretty sure this is entirely dependent upon the "temperature" parameter used when inferring. The higher the temperature the more uniform the response will be.

[drusepth]

Quick fix: the higher the temperature, the more varied the potential responses. For uniform responses, you want the lowest temperature.

[thefreeman]

Oof. I was worried I was going to mess that up.

[low_tech_love]

It's certainly not in any way whatsoever similar to "prompting" a human. And yes there are definitely random processes involved. For an extremely objective prompt you may get very similar results but for general stuff like "write an e-mail about this or that" it will be significantly different each time.

[gkoberger]

Sure, but it's not like they're intentionally randomizing it. You can set parameters (like temperature or penalties), but it's not intentionally randomizing things.