Having rights is a social construct. Unless you believe in divine order of things. But I suspect there’s nothing in physical reality that requires any rights to be granted to anyone.
The religious far outnumber the not so I think your "unless" is really the norm. Talking only the various Jesus fanclubs you have a literal divine right to privacy in confession and it's sinful to reveal another's secrets. The Adam and Eve creation myth establishes privacy when God created clothes.
The very concept natural rights is basically divine rights but without explicitly mentioning a god.
If having rights is a social construct as opposed to a universal truth, then you don't have any rights at all. You have temporary granted permissions, but not fundamental rights.
As such, it's much more likely that they are universally true rather than a result of human consensus.
The very concept natural rights is basically divine rights but without explicitly mentioning a god.