I believe that he's arguing that even if he said that, he shouldn't be punished. Only doing bad things is relevant.