Hacker News new | ask | show | jobs
by RobotToaster 1089 days ago
Does twitter's robots.txt forbid scraping? Judging by the fact it shows up in Google I'd assume not.