While having a moral right to something (or not) is definitely important, when push comes to shove it’s the legal rights that come into play.
Legally recognized rights tend to underpin most definitions of ‘rights’ someone has, since if the legal system doesn’t recognize it, it’s nearly inevitable it will be stomped on at some point with no recourse.
And when that happens regularly, it’s hard to claim it’s a right anymore as practically it isn’t.