[michaelmior]

Sure, you only need to compare when there's a hash collision, but you still need to keep all the lines in memory for later comparison.

[mannykannot]

Sure (though they could be in a compressed form, such as a suffix tree), but that wasn't the issue I was addressing.