[Shaanie]

Most likely it's not that they're outright telling him to move, instead they probably show disinterest or make it clear in some other non-confrontational way that they'd rather not have him sit with them.