[sesqu]

That's pretty much what the saying is about. The existence of an exception proves the existence of a rule. The reliability of the rule can be estimated by considering the exceptionality of the exception.

[kaizen-konpusai]

I like the alternate interpretation that understands "prove" to mean "to test" in this situation, so that "the exception tests the rule".