[account42]

You think they'll stick to those IPs any more than robots.txt when it comes to that?

[alt227]

Yes I do, I also think they will continue identifying themselves in the user-agent header.

https://developers.google.com/crawling/docs/crawlers-fetcher...