Y
Hacker News
new
|
ask
|
show
|
jobs
by
Quarrel
317 days ago
Which, just like robots.txt, worked decently well until the AI bot crawlers overwhelmed all else.