Buffett isn't entirely adverse to metals such as gold, the reason he doesn't buy gold is he doesn't think it's often undervalued.
His history with silver for example:
"Warren Buffett made an unusual move in 1997 when he bought 111 million ounces, or nearly 3,500 tons, of silver. The famed investor's purchase helped make Thomas Kaplan a billionaire."