I wear a pair and have minimal problems when wearing them. When they're off I would likely experience similar to yourself.