Hacker News new | ask | show | jobs
by jesterson 1025 days ago
All this "AI" garbage bots are being filtered on IP level for me.
1 comments

IP level filtering is purely a "better than nothing" approach, though. It's very fragile and porous. You have to constantly monitor your logs to find the new IP addresses to filter out as they are adopted, but the only way you'll see them in your logs is after they've already done the scraping.
There are multiple behaviour-based tools to use for spotting and terminating this sort of activities. I do agree however, it's a very tedious semi-automated task of monitoring logs, which many business wouldn't bother to have.