[ska]

You might want to think that through a bit more, leaving aside the issue of needing the underlying vector space, are you sure you are comfortable with the statement that all matrices are tensors?

[dbranes]

Yes absolutely. Given a matrix as an array of numbers there's a number of natural ways to interpret it as a tensor. What are you uncomfortable about?