|
|
|
|
|
by forgotusername
5141 days ago
|
|
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Disallow: /
User-Agent: googlebot
Disallow: /search
Allow: /
Woah, that is surprising. I note Bing has blogspot in its index anyway. Perhaps they use the ATOM API when they see a Blogspot URL? (technically not 'crawling') |
|