I’d say that most people who use it to describe a group to which they themselves do not belong fall into that category.