Hacker News new | ask | show | jobs
by buboard 2498 days ago
> There is an implicit contract

Then why can't publishers scrape google?
1 comments
mkl 2498 days ago
From http://www.google.com/robots.txt:

    User-agent: *
    Disallow: /search
    ...
link