There's no such right and even if there was, it would lead to perverse situations such as Britain getting to claim Calais which is closer to London than Paris (94 miles versus 147!).
There are the Channel Islands, but perhaps you could claim that the Channel Islands were the ones to occupy England and not vice versa since they were part of Normandy!