Hacker News new | ask | show | jobs
by sjwright 4444 days ago
Let people run rampant on your IP range, and this is what happens.

I run a fairly large website, and I block all traffic from the likes of Amazon AWS because it's full of dodgy bastards who think they're entitled to run however many HTTP requests they like. Webmasters, look at your web logs. Don't be surprised if the majority of hits are coming from bots pretending to be web browsers.

2 comments

SES uses different IP ranges than those used by EC2.
It's the same idea though. Web sites might block crawlers in EC2, and mail servers might block emails from SES.
Our company offers a frontend web performance scanning SaaS product. We use EC2 for our scanning boxes. I've found many of our customers's website filter EC2 IPs. Its mainly from websites that offer a high demand product with a large secondary market. (think ticket websites for concerts/musicals/plays, airlines, hotels, etc).
I'm surprised you're pointing the finger at AWS.

As far as I can tell, 90% of all that crap still comes from the shitty cheap home user ISP networks and el-cheapo web-hosting services.

Never seen much bot traffic from AWS.

(The bot that is currently pissing me off is Netcraft. The practice of just "guessing" domains and then firing http-requests at them is annoying.)