Hacker News new | ask | show | jobs
by tyingq 3355 days ago
Amazon rejects obvious non real browser user agents. This app tries to verify urls before putting them in the queue. I think they may have more anti scraper measures as well.