Hacker News new | ask | show | jobs
by Trinicode 100 days ago
A letter is not a token, is it? Redundancy could hit 75% in long sentences, but Shannon was not predicting tokens or words, he was predicting letters (characters).