The complex numbers in the matrices appear as a consequence of trying to do something else. I don't think they have much physical meaning on their own, which is why I am surprised that people ask what it would mean if they had to all be real numbers.