[emilsedgh]

I have a project which includes a huge list of websites which must be scraped heavily. My question is... Are these kind of tools suitable for 'heavy lifting', scraping hundreds of thousands of pages?

[meritt]

Yep. It's just a GUI that generates scrapy (python) code.