Because they get details on items in your safe, that you thought were hidden. The second you buy precious metals with physical delivery, you get not only the criminals who break into houses in your wealthy area, but also the criminals who specialise in stealing and selling the things you just bought.