Y
Hacker News
new
|
ask
|
show
|
jobs
by
Nycto
3355 days ago
Fails for Amazon URLs, too (And no, I didn't include a referral link in there.)
1 comments
tyingq
3355 days ago
Amazon rejects obvious non real browser user agents. This app tries to verify urls before putting them in the queue. I think they may have more anti scraper measures as well.
link