Hacker News new | ask | show | jobs
by dabluck 1039 days ago
This is exactly backwards. Google will happily not index any of your content with a simple robots.txt file. These companies are desperate for Google's traffic. They should be paying Google for it!