[Maro]

I've written a few articles about Entropy (I'm a physicist working in DS).

Almost all of them have Python code to illustrate concepts.

-

1. Entropy of a fair coin toss - https://bytepawn.com/what-is-the-entropy-of-a-fair-coin-toss...

2. Cross entropy, joint entropy, conditional entropy and relative entropy - https://bytepawn.com/cross-entropy-joint-entropy-conditional...

3. Entropy in Data Science - https://bytepawn.com/entropy-in-data-science.html

4. Entropy of a [monoatomic] ideal gas with coarse-graining - https://bytepawn.com/entropy-of-an-ideal-gas-with-coarse-gra...

5. All entropy related posts - https://bytepawn.com/tag/entropy.html

[dr_dshiv]

What’s the difference between information entropy and physical entropy?