Are you subsidizing them, though? High-risk areas often require expensive insurance addendums or proof of self-insurance. We deal with this in Houston and our numerous pockets of 100yr floodplains.
California only recently dropped the twin requirements of "insurance cannot be priced according to future models" and "insurance premiums can only rise X% per year", the effect of which that everyone else definitely was subsidizing the people in wildfire zones.