[BrandonM]

I would hazard a guess that CPython (the reference implementation) hooks directly into C for bitwise NOT, and therefore, it would matter.