It's not just that if you use a lora, like this: https://www.reddit.com/r/StableDiffusion/comments/1fe7d7o/am...
or this:
https://www.reddit.com/r/StableDiffusion/comments/1eywnv8/re...