|
|
|
|
|
|
by whoami_nr
408 days ago
|
|
|
Author here. Yeah totally agreed. The more rigorous way to do this would be to use a fixed seed and temp and in a local model setting and then sample the logprobs and then analyse that data. I had an hour to kill and did this experiment. |
|
|