I live in Britain and don't have an issue with it, '#' is originally a symbol for pounds, a shorthand for 'lb', and we are used to the idea that pounds can mean weight, as well as our currency, so why not this symbol as well?
It's believed the 'pound' in pound sterling came from a pound of silver or silver coins in weight originally as well.
I believe it is related to them both being called 'pound', and it is very annoying. The two are not the same symbol, I don't know why they equivocated them. Technically in a distant root they are related, but they are distinct in usage and meaning.