Ironically that's why we had to get one in the first place. However, in the US, SUVs and Pickups outnumber sedans, so the majority of people sit at the same vantage point.
I don't think that's a casual relationship though. SUV drivers are probably more distracted because they are more likely to have kids in the back, they might just be worse drivers, etc. Too many factors to say if it's the SUV's fault.
One easy way to find out is to compare proneness to pedestrian collision—fatal and non-fatal—and see if the difference is nearly as great as when comparing only fatal accidents.
But I really don’t see why you’d even guess otherwise. Much larger and taller front compared to a smaller car means it’ll basically hit your abdomen instead of your legs. Higher weight means tha it’ll hit you with greater energy, and won’t brake as easily. In my mind, of course pedestrian accidents involving SUVs are more often fatal, so I wonder what goes on in yours when you say that you think they aren’t.