Most allergies are to a protein in the thing you are allergic to, and refined oils that have a high smoke point usually have all of that removed (or it would cause the oil to smoke.) I have a peanut allergy but can eat anything fried by a cheap restaurant in Sysco peanut oil while I have had a reaction to something done by a three star restaurant because they used unrefined oil (looking at you Manressa...)