[alecst]

So I studied physics and know a fair bit of stat mech. I, like you, know that the entropy is the weighted log of the number of microstates of a system. Does this help me understand that? What are the different states/outcomes? What are the probabilities of being in a specific state? Also what equation are they using? I'm not sure what this is supposed to help me understand.

Also the entropy you calculate depends on what you know about the system in question...

[hervature]

That function is simply -xlog(x)-(1-x)log(1-x) where the logs are in base 2. In general, entropy is E[-log(P(X))] for any random variable. Microstates and such are a physics/chemistry centric application and the namesake but mentioning states is never done from an information theory perspective.