[vardump]

I wonder whether there are some prefixes that cause (some) CPUs to execute the instruction a lot slower.

[jxors]

This is indeed a thing. I believe in general instructions are executed slower when there are more than 4 legacy prefixes. And there are plenty of other timing differences between different microarchitectures