The risk of a fatality or life changing accident is much much higher for a cyclist colliding with a car, than it is for a pedestrian being hit by a bike
Risk is an aggregate of damage and likelihood. Pedestrians are moving much more erratic than cars. This makes them more dangerous, unless you live in a community so violent that drivers actively harass cyclists.