Hacker News new | ask | show | jobs
by trollbridge 409 days ago
I already get hit by literally hundreds of crawlers, presumably trying to find grist for there AI mills.

One more crawler for a search index wouldn’t hurt.