[lelanthran]

I think that if you stick to a definition of 'fair use' that allows the slurping of entire corpuses, then copyright doesn't have any teeth anymore.

If the license makes the data public viewing, like with websites, then slurp all you want. If the license forbids automated bulk processing, then stop whining about fair use and pay for a license that allows bulk processing.

"Out system actively uses every single byte of data to produce any output" is so obviously not the intention fair use clauses.

[surfacedetail]

Fair use doesn't exist in the UK.