You mean like a brick building? like how structures were originally built? Seems like a good idea to me for house to be made of stone in high fire related areas. Obviously the cost would be astronomical.
Brick buildings don't do well with earthquakes. California also happens to sit on a major, active fault line. While it is technically possible to make a brick or stone building earthquake-proof, I would imagine it's cost prohibitive for large scale single-family housing projects. Apartment towers are already built with a multistory steel-reinforced concrete base that is built to withstand earthquakes, but it would increase costs significantly to build to the top like that.