If you really do yield to pedestrians than I suppose they don't but most bicyclists are -- like smokers -- not nearly as considerate as they think they are.
My basic strategy is to wait until at least half of the sidewalk is open before passing any pedestrians. I have no problem coasting at pedestrian speed until I have a passing opportunity. It still beats walking.