Hacker News new | ask | show | jobs
by ralfd 1 day ago
I dont get the irony.

Google respects if one doesnt want to get indexed by the crawler:

https://developers.google.com/search/docs/crawling-indexing/...

1 comments

And it has from the start, right?