Side-loaded apps still have permissions.
I agree on all your other points, though I don't know how a project like this could be made to work with the android market model.