But you do.. Sort of. One of the original signatories of the treaty of the metre, and all of your silly units for length and mass at least are defined in terms of SI units as of 1959 [1] [2].
So when you give someone an inch, you're specifically giving 25.4mm ;)