[ankimal]

Can you provide some insights into performance? In my experience, a single page could take between 5-10 secs. to scrape.

[BaconJuice]

Is this really scraping the data or just checking for links and getting status?