The OP's point was that 51% of miners could agree to a change, and in a system where there are very large players that might not involve that many people.
And it already happened a bunch of times. Bitcoin has been forked a bunch of times, and one could argue the fork that gave birth to Bitcoin Cash was a successful 51% attack on Bitcoin itself.