Y
Hacker News
new
|
ask
|
show
|
jobs
by
watchdogtimer
1923 days ago
You could do this using a robots.txt file (assuming the scraper obeys it, of course).