Of course, you want an adversarial network that's difficult to trick, otherwise the training will produce suboptimal results.