Hacker News new | ask | show | jobs
by _a_a_a_ 931 days ago
'perplexity'?
2 comments

The wiki link is good. In the context here it's easy to picture it as how weird a sentence would sound to a native speaker. Low perplexity means what was generated would be unsurprising if you saw it in the dataset.
I'll check the wiki link, but how is perplexity different from the measure of Surprise, in terms of Shannon's stuff?