It varies by vaccine, but allergies, health conditions, and age are all factors.
Some people also practice religions that forbid them.