|
|
|
|
|
by hervature
1567 days ago
|
|
That function is simply -xlog(x)-(1-x)log(1-x) where the logs are in base 2. In general, entropy is E[-log(P(X))] for any random variable. Microstates and such are a physics/chemistry centric application and the namesake but mentioning states is never done from an information theory perspective. |
|