You just blew my mind with this comment. I'm a statistics undergrad student and I really need to up my math knowledge. Where is this fact from? Functional analysis?
Yeah that would be a good course to learn it - functional analysis is basically linear algebra on infinite dimensional vector spaces. (Though that sells it a little short - moving to infinite dimensional vector spaces requires incorporating some topology too.)