Hacker News new | ask | show | jobs
by kccqzy 638 days ago
The AI scrapers are failing to discover something old-style search engines have been doing for decades: respecting a host and not giving them too much load. I'd say you did a good job banning those that generate noticeable load.