[nickbauman]

I think you're also ignoring the "transformative" clause written into the fair use doctrine in the US.

...the extent to which the use is transformative. In the 1994 decision Campbell v. Acuff-Rose Music Inc,[13] the U.S. Supreme Court held that when the purpose of the use is transformative ... is more likely to favor fair use.