Seeing "boorishness" and "pursuit of sexual gratification" as inherently bad things is indeed a cultural phenomenon. There are cultures that explicitly reward one or both of these.
The problem is the combination of the two, although the former is discouraged most everywhere. Being a pest is not a matter of culture, but an individual choice.