Hacker News new | ask | show | jobs
by Petrakis 2910 days ago
Also depends on the ToS of each page, and their robots.txt should allow or disallow crawling