I see what you mean but this is definitely not universal about stylegan and it depends on factors such as size of the training set (I'm guessing it was smaller here) and training parameters.
Honestly this seems to be common for GANs in general. Though I don't think most people have looked through CelebA. But if you are lazier, you can scroll through thispersondoesnotexist and you'll find essentially celebrities with similar characteristics to what the OP is saying. More so, you actually see better quality images the closer to a celebrity they look (you see the same thing in the tune version here). I do think ADA is typically worse than the typical StyleGAN2, but that's the tradeoff you get with a smaller sample size (worse because people are training it on smaller datasets so more memorization).