Problem is, many of the reasons people prefer in-office require the rest of us to be in the office. Some are manageable, if you like the social aspect there will be others like that and they can be social together. Others like "better collaboration" really require a decent chunk of your immediate team to be there.
If people who want to work from office find themselves in empty office then they need to adapt to this new paradigm shift the same way rest of us adapted to loud open offices where anyone can walk up to anyone and interrupt the flow.
Some people adapt to whatever reality is while others force their responsibility of adaptation on their peers/environment.