|
|
|
|
|
by brucethemoose2
845 days ago
|
|
I just loaded it in vllm with default settings. I can't share the eval, but it's pretty simple: it asks a question about some data, and is restricted to only answer yes/no (based on the output logits and suggested in the prompt). It's called with 0 temperature and only 1 output token, so sampling shouldn't be an issue. |
|