It took 31 years before I ever caught the real flu (influenza), and not just a cold or stomach flu. And most people in my family or my friends have never had it.
Your friends and family might never have had serious influenza symptoms. But asymptomatic infections are very common so it's likely that some of them have at least been infected.