[akshayubhat]

I can only think of using 80legs as a crawler, since its distributed enough to make sure that you don't run into any IP address based rate limitation. But it's just a guess.

[slig2]

You probably can't do it, because 80 respects robots.txt AFAIK.