Y
Hacker News
new
|
ask
|
show
|
jobs
by
Arnt
519 days ago
I'm curious — if that's your attitude, why not all bots? You can say "User-Agent: foo\nDisallow:\n\nUser-Agent: *\nDisallow: /" to allow only named bots and reject them by default.