[croes]

Isn't GPT4 non deterministic?

So the same prompt won't necessarily give the same result

[7bit]

Yes, it is non-deterministic from our point of view, because OpenAI does not let us set the seed.

[ukuina]

Sure you can: https://platform.openai.com/docs/api-reference/chat/create#c...

It does not guarantee determinism, though, because of the nature of GPT4o's optimizations.