Because the speed and the weight of the vehicles driven by motorists are generally so large that they tend to kill people in a collision. The same is not true for cyclists.
A pedestrian struck by a bicycle can absolutely be killed. It's not an uncommon occurrence, and it doesn't happen more often only because it's easier for a pedestrian to get out of the way of a bicyclist.