Hacker News new | ask | show | jobs
by sillysaurusx 2149 days ago
You can’t! :)

It’s a fact of life. A different model will generate different outputs for the same prompts. And some of those outputs will be worse than they were.

But, if you use the same prompt with the same model, the output will always be exactly the same (content filters notwithstanding).

2 comments

> But, if you use the same prompt with the same model, the output will always be exactly the same (content filters notwithstanding).

Isn't this only true if you set the temperature parameter in a way that renders the model deterministic?

The temperature parameter controls a random number generator, which itself is controlled by a seed. I assume (or hope) you can specify the seed via the API.
Even the same model generates different outputs for the same prompts. GPT has a temperature parameter that allows you to restrict the variety of text generated but even then the output differs for the same model and prompt