I'm assuming he means that solid-propellant rockets are conceptually simple to make; rocks being either the explosive at the end (akin to throwing stones) or maybe the basic fuel and oxidizer propellant mix. Either way it's the idea that the most well funded military on earth could make another rocket factory easily if needed.