Hacker News new | ask | show | jobs
by vesterr 6627 days ago
That stuff is really easy.

And you may convince them to join you after all, like YouTube and the media companies they parasite off of.

1 comments

I didn't say it was hard.

It's also very easy to differentiate between a crawler and a user. But they don't even have to do that. Blocking the entire AWS ip range isn't hard either. I doubt any craigslist users browse the site through AWS :)