There are some parallels to Stoic philosophy there. Ancient stoics would exercise regularly but state the health effect as a secondary benefit, the primary benefit being the virtuous exercise of discipline.
Anyone who had to do military draft will confirm it. Even after 9-12 months of mandatory service you don't come back buffed like a body builder - but the daily exercise and regime puts you in a different state of mind.