The power in generative models lies in being able to flexibly generate images that belong convincingly to a set (e.g. faces, landscapes), but that are not actually in the input dataset. E.g. you can make images that look like faces, but that don't belong to any real individual.