|
|
|
|
Ask HN: GPT non-deterministic, feature or bug?
|
|
1 points
by jyu
1036 days ago
|
|
|
Seems like GPT non-determinism is mostly from sparse MoE. Imagine if you use a DeepMind approach of tree traversal for the most promising paths, it can generate deterministic LLM responses. |
|
|