Hacker News new | ask | show | jobs
by burtonator 1032 days ago
There must be a relationship here between Shannon's estimation that english is 1 bit of entropy per character and is highly redundant and 'easy' to predict.

A highly advanced AI could compress the text and predict the next sequences easily.

This seems like a direct connection like electricity and magnetism.

And maybe that's why English needs to be about 1 bit because we're not very intelligent.