|
|
|
|
|
|
by nuggien
6627 days ago
|
|
|
I didn't say it was hard. It's also very easy to differentiate between a crawler and a user. But they don't even have to do that. Blocking the entire AWS ip range isn't hard either. I doubt any craigslist users browse the site through AWS :) |
|
|