You don't need to explain this. Literally everyone here knows what you said, and everyone - including you - knew that he also knew that.
This is pointless and annoying nitpicking.