Can't speak for the others, but by merely saying "please don't think I'm being rude ..." you explicitly remind the other side that being rude is an option, and that what follows should not be taken literally. Indeed why would you say "don't think I'm being rude" except if you already anticipated that the other side will take it as being rude.
Trust me on this, I'm not lying to you ...