Drag goes up proportional to the density of the fluid. Having more oxygen to run your engine will give you more energy, but I suspect that it won't keep up with increases in drag.
Yeah I suspect this is it. The density is inversely proportional to temperature and drag is proportional to to density. Even if the engine is more efficient (in a steady state) with denser air, the relationship is probably sub-linear.