Hacker News new | ask | show | jobs
by basch 111 days ago
That’s not true in practice thought https://sulbhajain.medium.com/why-llms-arent-truly-determini...
2 comments

Even if it were true he would still be wrong. I wish HN had some mechanic to evict these sorts of troll accounts that attempt to score rhetorical points rather than honestly learning about a subject. The usual vote and flag mechanics don't work here because there's no singular and overt violation of the guidelines taking place.
that is why I said

>If you control the randomness involved

Which you essentially cannot do

It is inherently randomized

But isn't the link shared by that comment doing exactly that

https://sulbhajain.medium.com/why-llms-arent-truly-determini...

>The Thinking Machines research team showed it’s possible to fix this. They built batch-invariant kernels for RMSNorm, matrix multiplication, and attention, integrating them into the open-source inference engine vLLM.

>The outcome: 1,000 identical prompts, 1,000 identical outputs. Perfect reproducibility.

??