|
|
|
|
|
by yters
1947 days ago
|
|
It's a very important point the paper makes, which is the disconnect between what is commonly called Shannon information (he actually called it entropy) and what we call information in normal parlance. A channel may transmit a high amount of Shannon entropy, but contain zero information of the regular sort, since the transmission is just random noise. A concept that is closer to our intuition is mutual information, so named by Shannon's colleague precisely because Shannon entropy is not concerned with semantics. |
|