I suggest you read up on nearly neutral theory and think about the fate of nearly neutral mutations (the vast majority) in groups with small effective population size (like humans).