Sure, if tools are dirt cheap you can just sacrifice to Benford's Law and use base 10. If tools are not cheap, you'll learn to use base 2, one way or another.
I doubt I'll ever be able to quickly add fractions in base-2 (it doesn't happen often enough to train this), so pen+paper will always be a necessity if I wanted to stick to imperial. I could see getting the intuition for "which line is the eights vs sixteenths" over time though, but if the one-off calculations are going to be such a pain, I don't really see a point.