[larrys]

PG: "A couple weeks ago I banned all Google crawler IPs except one"

With regard to this issue doing the above is not evidence of knowing your shit in the area in question.

[einhverfr]

To be honest, I disagree. The fact is that people who know their shit shoot themselves in the foot occasionally. That's how they come by the shit they know. Timid people rarely know their shit because they are too afraid to make mistakes.

Being bold is an important aspect of getting to know your shit.

Also, besides this, this action has gotten us talking about how Google throttles crawling, and this discussion has further reduced my opinion of the World's Largest Adware Vendor.

Now if I were to ban Google searchbots based on what PG is saying I would simply limit them to the first page or two of listing. I think this can be done in a robots.txt?