Do a blower door test and see where the air is coming in/out:
* https://www.energy.gov/energysaver/blower-door-tests
* https://www.youtube.com/watch?v=msZ_E-4GFs8
* https://www.youtube.com/watch?v=Q5vHxgq7GKo
Then plug the holes.