Y
Hacker News
new
|
ask
|
show
|
jobs
by
vectorEQ
2331 days ago
i'm wondering if that robots.txt might then get you sued due to blocking scrapers / bots?
2 comments
herval
2331 days ago
A robots.txt file doesn’t block scrapers, it’s the equivalent of a no trespassing sign. I don’t think putting up signs will suddenly become illegal?
link
setr
2331 days ago
Robots.txt doesn't interfere with anything. It's a suggestion.
link