Hacker News new | ask | show | jobs
by ademarre 2499 days ago
Googlebot actually used to support a noindex rule in robots.txt, but they are removing it.

https://webmasters.googleblog.com/2019/07/a-note-on-unsuppor...
1 comments
jefftk 2499 days ago
Yes, that was linked above. It looks like this is part of reducing support to what's in the spec?
link
ademarre 2499 days ago
Oops, yep. I didn't see that context.
link