[etangent]

"[before computing SVD], we normalized each entry according to the square root of the product of its row and column sums."

Why didn't they use something that usually works better, like PMI?

[rspeer]

This is a normalization that I have used and seen other people use. I don't think it's a foregone conclusion that PMI is better for every task.