I think the position lacks nuance, but I can easily undermine it. If anything, in person work favors people, who rely on relationships rather than skills. Remote is almost the exact opposite of this as it requires a verifiable result.
I did not claim that mine was right or nuanced, but that OP' claim was easily subverted with similar claim. As for the shoulds, I think a lot of people are afraid of working remotely IF they are held accountable ( I am willing to accept not everyone has the same level of focus, follow through and so on ) . But that is the fun part, management is either unable or unwilling to learn how to manage remote workforce so from a 'slacker' perspective, it is, likely, an ideal habitat.
Why would they be afraid if management can't wrap their heads around it.
But, and I may have mentioned this on this very forum, that is a management failure.