That's because you know that most of you are "not American" when you're in Canada.
Travelling Canadians outside the country tend to sprout flags.