|
|
|
|
|
|
by dotancohen
516 days ago
|
|
|
Sounds to me like you might want to reduce the Top P - that will prevent the really unlikely next tokens from ever being selected, while still providing nice randomness in the remaining next tokens so you continue to get diverse stories. |
|
|