If you want to keep people out of the places cars are actually supposed to go, but let them be on sidewalks and such, then it's fine to have some restrictions. And likewise let drones fly under 400 feet.
But you shouldn't be banning people from the roads either, that's been a big problem making cities worse over the last century.