Hacker News new | ask | show | jobs
by tep 4972 days ago
" Common misinterpretation on how Google handle `Disallow` in robots.txt"

Here is why I think this happened: http://www.facebook.com/humans.txt

;)