[drakaal]

I have personally had to get sites that use CloudFlare re-listed after being booted from Adsense, or Google because Cloud Flare served a different page to bots than to users and kicked off the Access Restricted Page.

You keep saying we serve off of one IP that is blatantly false.

I'll put my Crawl Rate Up Against anyone's because we had to have a conversation with Google's team because their Bot hit one of our sites for 1.2M crawled pages in 3 hours. Which is nice, but then they did it again the next day. and the next. So we are negotiating to not have to pay for Google bot traffic.

In webmaster's tools you can't even change the setting of a CDN In A Box Site, because Google Assigns you a Special Crawl rate.

Bing's Bot loves us, because they will often crawl "all pages at once" so they will crawl 10k pages in 30 seconds. and go on to the next site.