Y
Hacker News
new
|
ask
|
show
|
jobs
by
rsbadger
1460 days ago
AFAIK, most of those "private" links are actually just "unlisted" but they're still public. I'm sure Bing is indexing those too...
1 comments
Gigachad
1459 days ago
Anything private should ideally be put behind authentication. If that isn't possible, than robots.txt. Search engines are _meant_ to index everything that is publicly accessible and not blacklisted on robots.txt.
link