Y
Hacker News
new
|
ask
|
show
|
jobs
by
gavinhking
907 days ago
Yup, here is an example with all listed agents, although you probably want to modify it to not fully block all of them:
https://darkvisitors.com/robots-txt-builder