Hacker News new | ask | show | jobs
by srean 27 days ago
Good compression, necessarily, requires good "next token" probability estimation. I was essentially using zlib's implicit probability estimator.