[mikiem]

I should add that some sites (especially ones counting on ad revenue, or that don't want "scalpers") may consider bots hitting them as abusive and will either contact us or just block specific IPs. At that point we know what is going on. Our customer may call us because "it stopped working" when they have been blocked or rate limited. I will point out that many sites that bots hit do not care at all and know it is happening.