|
|
|
|
|
by cyrnel
519 days ago
|
|
Seems some of these bots are behaving abusively on sites with lots of links (like git forges). I have some sites receiving 200 requests per day and some receiving 1 million requests per day from these AI bots, depending on the design of the site. |
|