Y
Hacker News
new
|
ask
|
show
|
jobs
by
the_dege
1913 days ago
Sometimes website admins will also try to report your ips to the service provider as a source of attacks (even if not true).
1 comments
DocTomoe
1913 days ago
Given how often I've had misbehaving crawlers slow own servers in the early 2000s, I do not see how a crawler that disobeys robots.txt is not an attempted attack.
link