[strken]

That's not really the same as not caring about your co-workers as human beings, though. I'm happy to leave introverts alone and not drag them to unhappy hour with me, but they're still worth something as people, and I'd still help them out if they e.g. got hospitalised and needed someone to bring them clothes and a book.

I interpreted "I don't care about you as a person" as "I don't think you have moral worth outside your instrumental value to me", which goes beyond rudeness and into questions of whether the person can be trusted at all.