|
|
|
|
|
|
by dartos
488 days ago
|
|
|
> LLMs can be deterministic if you set the temp to zero. At which point, you the major benefit statistical models like of LLMs… A lot of performance is lost if you fix the sampling step like that as well. That’s why nobody does it… |
|
|