Cars have much more inertia and often more traffic than pedestrians, it makes sense to give them right of way and reduce the ambiguity with traffic control devices in most places.
If you take sidewalks away completely and turn everything into a big highway you’ll have even less pedestrian traffic. That doesn’t make it good policy.