You're right that 'white carbs' should be pretty much eliminated. However, 100% whole grain bread is still valid and has a good amount of fiber, which white carbs lack.
I'm stealing this from somewhere, and I don't recall the source. But someone said "enriched" flour is like this: You're walking down the street. A mugger steals your watch, your wallet (including credit cards), your belt, and your glasses. Then he gives you back your belt and $20 from your wallet, and says, "There, I've enriched you".
I've read that modern "dwarf wheat" has an enzyme that interacts with the same neurotransmitters as opiates, prompting withdrawal symptoms if one doesn't have it again in a few days.
I've got strong source amnesia and am probably misremembering details: maybe it was from "Grain Brain"? [0]? At any rate, my experience has been pretty similar to yours.
I'm stealing this from somewhere, and I don't recall the source. But someone said "enriched" flour is like this: You're walking down the street. A mugger steals your watch, your wallet (including credit cards), your belt, and your glasses. Then he gives you back your belt and $20 from your wallet, and says, "There, I've enriched you".