What's immoral is that I'm forced to be governed under an unfair agreement that I had no say in accepting. Giving some people more votes because they live in a different state is absolutely immoral, agreements change.
You vote, you didn't leave for somewhere else. How can you otherwise consent to being governed without you individually being in charge? There are people who would think how you want things to be governed to be unfair, how do you reconcile that?