Hacker News new | ask | show | jobs
by threeseed 497 days ago
From the docs:

“While Google won't crawl or index the content blocked by a robots.txt file”

They will show the URL if someone else has linked to it. But the content itself is not indexed.