Hacker News new | ask | show | jobs
by soroushjp 1042 days ago
In my own experiments with OpenAI's GPT-4 API with temperature set to zero, I was still not getting deterministic outputs, with some small variations between completions. Not sure why, and I haven't had a chance to dig further or talk to their team about why and how this happens.
1 comments

Non-determinism in GPT-4 is caused by Sparse MoE [0]

[0] https://news.ycombinator.com/item?id=37006224