That's fine if it you prefer it. The question is whether you can use the force of law to prevent other people from realizing their preference on their own property.
But the answer is obvious: if the force of law can be applied over home design preferences, there is no longer such a thing as private property.Yes, there is a clear need for building regulations related to safety, but that’s an entirely different argument.
The problem is that some of people's preferences include externalities. I prefer that my neighbor upstream not dam or pollute the creek that runs to my yard. I prefer that my neighbor behind me not put up a 100 foot concrete wall that blocks my view of nature. But it's their property, as you say. So people band together and decide that they want to live in a community that abides by certain rules and pass zoning laws, getting us where we are today. Externalities are a thing, and surely at least some zoning makes sense.