[tajen]

> deep links, formatted differently

Strictly speaking, you are only allowed to connect to a remote computer if you agree with their Terms of Service. I guess there are legitimate round corners, like you need to fetch the ToS first. It's not applicable as-is for the WWW, but you need to accept the websites have a say in how their results should be displayed.

Btw, is Robots.txt legally enforceable? http://www.robotstxt.org/faq/legal.html