Of course they can't create new facts, other than in principle, ones that can be derived from the training data.