|
|
|
|
|
|
by threeseed
410 days ago
|
|
|
> that I don’t blame site owners for blocking all bots except googlebot I run a number of sites with decent traffic and the amount of spam/scam requests outnumbers crawling bots 1000 to 1. I would guess that the number of sites allowing just Googlebot is 0. |
|
|