Y
Hacker News
new
|
ask
|
show
|
jobs
by
rsbadger
1457 days ago
I do have a robots.txt to block this directory. But Bing only listens to that for what to crawl, not what to index.