Y
Hacker News
new
|
ask
|
show
|
jobs
by
sprizzle
4660 days ago
The robots.txt file doesn't seem to disallow scraping.
https://news.ycombinator.com/robots.txt
1 comments
karangoeluw
4660 days ago
Scraping the listing pages seems allowed though.
link