Hacker News new | ask | show | jobs
by boxed 1459 days ago
robots.txt disallow is ignored for my production site at least. This is super bad.
1 comments

Same for us - we have robots.txt disallow etc. and the relevant headers for personal customer links and Bing is ignoring and publishing all the same