Hacker News new | ask | show | jobs
by canjobear 1710 days ago
No, the interesting thing about Shannon entropy is that it is totally independent of how information is represented (as symbols, alphabets, numbers, structured objects, whatever).
1 comments
dr_dshiv 1710 days ago
It is based on the symbol set exchanged, so how is it independent?
link
canjobear 1710 days ago
Information is a function only of the probabilities, not of the symbols.
link