The price at the pump affects not only a voter's commuter car, but also every truck that delivers goods across the US. This may have a much larger knock-on effect.
OTOH the US is the largest oil producer in the world [1]. Theoretically the US could keep domestic prices in check, but that would require rather drastic administrative pressure, likely only legal at wartime.