Hacker News new | ask | show | jobs
by jibal 19 days ago
> It’s not just an analogy or a coincidence that the word “entropy” is a word used in both physics and computer science (information theory).

Shannon asked von Neumann what to call it, and von Neumann said "You should call it entropy, for two reasons: In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, nobody knows what entropy really is, so in a debate you will always have the advantage."

1 comments

I’m aware of the von Neumann joke.

There is, however, a direct equivalence between them derived from the 2nd Law of Thermodynamics. https://en.wikipedia.org/wiki/Landauer's_principle

Um, only the second part was a joke. The first part was confirmation of your statement that it's not just an analogy or coincidence ... and Shannon followed von Neumann's advice (not joke).