[cafard]

Well, yes: but gymnos (like the Latin nudus) can also mean lightly clothed. I assume that the men in the gymnasium did exercise unclothed, though.