Wrong. Ultra-vires laws can be challenged after the fact that they were broken. If the law in itself was invalid, that is a valid legal defence.