Hacker News new | ask | show | jobs
by notastartup 4237 days ago
I love what they are doing with kimono and import.io

There's no free lunch lets put it that way. It's free, it's simple but limiting for doing anything heavier. It covers only a small portion of the websites. You can't crawl all the links in a website and hard to scrape data from dynamic webpages etc. Also I found that some websites wouldn't even load making it impossible to define the fields to scrape.
1 comments
davidbarker 4237 days ago
I tend to stick with KimonoLabs, but I did try http://parsehub.com for a while. It's a lot more complicated, but it allows you to scrape dynamic sites.
link
scrape-it 4237 days ago
Excellent choices. We try to take the pros and cons from each of those services and make it better. Basically, Scrape.it aims to be simple to use like Kimono and able to handle complex websites as well.

You can scrape websites like Kayak and Airbnb as well by following the Scrape.it Tool.

We also have a dedicated number of hours every month to create the jobs for you so you could just tell us the websites you want to scrape.

We then monitor the jobs so that they will continue working without interruptions (ip throttle, website layout changes).

link