Hacker News new | ask | show | jobs
by oh_my_goodness 1520 days ago
The point is pedagogical. Entropy takes a lot of time for people to understand clearly. That is the discussion from the OP.

Adding "knowlege" to the definition (or to an initial explanation) of entropy makes that learning process even more difficult. And it's unnecessary. It's better than the older talk about "disorder" but it's distracting. We can bypass 'knowledge' and come back later, with no penalty and plenty of time savings.

Apart from that single pedagogical point, we seem to be saying the same things back and forth to each other in different words. I'm not sure why.

2 comments

I think that the "microstate counting" approach - if that's what you are defending - doesn't allow to understand entropy clearly because only works for the microcanonical description. It doesn't make sense to count the microstates for a volume of gas at some pressure and temperature. (Which is the standard thermodynamics problem.)

The concept of how much can we tell about the microstate given only the pressure and temperature seems quite natural and a better starting point. Boltzmann's entropy is a nice illustration but there is no reason to avoid the general concept.

> It doesn't make sense to count the microstates for a volume of gas at some pressure and temperature.

But nobody does that since the total value of entropy isn't important. What you do is count the factor difference in count of microstates between two volumes, that is what you care about, and it is easy to see how the number of microstates changes when you double the volume or other similar changes.

Is it easy to see how the number of microstates changes when you increase the temperature - everything else being equal?

How would you say that it changes then?

I'd say that the number of compatible microstates doesn't change. The probability of each microstate does change though.

Your statement doesn't make sense, temperature is defined in terms of entropy changes, you can't calculate temperature without first calculating entropy changes.
Have you heard of thermometers? I can have a container with 1l of some gas at room temperature T1 and proceed to heat the room - and the container - to temperature T2.

How do you calculate the number of microstates for the sample of gas before and after? How do you think these numbers are related? You said it was easy!

Thermometers is a way to measure temperature, it isn't its theoretical definition. Temperature is defined as energy required per change in entropy. There is no other reasonable way to define temperature, since at its core it measures which way energy flows when two macro systems are connected. Temperature tends to go up as you add energy to things, but not always, for example temperature doesn't go up when you melt ice, it starts and ends at 0 degrees C.

> How do you calculate the number of microstates for the sample of gas before and after? How do you think these numbers are related?

If you added energy to the gas by heating it, lets say you doubled the energy, then you now have twice as many energy packets to distribute between the particles. This adds a lot more microstates that wasn't available before, and none of the old microstates are now possible since all old microstates had a total energy level half of what each new microstate has. You can calculate the change in states yourself, it is just discrete normal probability theory. Note that the base rate isn't interesting, you care about the change of the logarithm of number of states.

And of course the "knowledge" part - the entropy being a function of the probability distribution for the microstate conditional on the macrostate - is there just the same in the microstate counting approach. (Where the latter is applicable!)

If given the macrostate all microstates are equally probable we can just count them. The more there are the higher the entropy.

In general we have a probability distribution for microstates conditional on the macrostate. To have a clear understanding of entropy that should be at least mentioned.

Of course you can count micro states of a gas within dE or delta-E of some total energy. The density-of-states approach is exactly that.

I thought we were discussing statistical mechanics.

> I thought we were discussing statistical mechanics.

This is from the message that you first replied to in this thread:

"Typically when you calculate the entropy of a system at temperature X, that means all you know is that you stuck a thermometer in it and measured X. You don't know anything more than the average temperature. It could be in any state consistent with that temperature."

Will you tell students to count the microstates consistent with the temperature?