I regularly sit outside with my shirt off in ~20F weather and don't get cold enough to have to go inside.
Direct sunlight makes all the difference. With the sun, sub freezing air temperatures can actually leave you feeling quite warm.