And for that theoretical tiny category there are tax deductions and other exceptions to the law (for instance in many jurisdictions sites of religious worship are exempt from property tax). The overwhelming majority of owners do not and should not qualify for this.