Hacker News new | ask | show | jobs
by bob1029 461 days ago
I'm not 100% sure what you mean by this, but there is token probability available in some providers:

https://cookbook.openai.com/examples/using_logprobs

1 comments

I think logprobs functionality was removed because it allowed to exfiltrate the last layer of weights of their propietary models