Sure. But just because something is self-deprecating and a (just barely funny) joke doesn't make it acceptable. Context matters, and this was literally the first thing the guy said to me.
"Normally when I'm hanging out with someone that looks like you, I'm playing Dungeons and Dragons." Is that purely self-deprecating (assuming playing Dungeons and Dragons is such..)?