The average person doesn't host a pool parties 100+ days out of a year as an Airbnb unit might. Filing complaints against a single noisy neighbor would also be a lot easier than doing it against people who will be gone by the time anyone looks into the matter.
There's a big difference between dealing with something from a neighbor's property once in a while, trash ending up in my property, guests not following neighborhood rules for parking, etc., and having to deal with it every single day.
Neighborhoods have a lot of societal norms, my house has frequently been referred to as "the rental" even though I've lived here for years and the prior tenants also all had long runs here... even being a rental house in the neighborhood is considered strange here.
The people behind me have done it a few times. How can i tell they had "guests" over?
I find beer bottles, coke cans and garbage on MY property. There is the obvious noise from the late night "pool parties" as well.
Normally people dont care what their neighbours do, but when it starts to impact others, people start to care.