Hacker News new | ask | show | jobs
by QuadrupleA 1157 days ago
Perplexity scores are pretty common, which I think involves taking a text corpus like wikipedia and seeing how well the model predicts the next word (token) of it.