Y
Hacker News
new
|
ask
|
show
|
jobs
by
LamaOfRuin
1624 days ago
As a matter of fact, robots.txt is a well understood expression of intent which is legally meaningful in a lot of contexts.