Mostly it's about penetration.
Any radiation that can get through your skin can do damage. Once that happens, the question is then how much flux is there doing damage.