Hacker News new | ask | show | jobs
by johnnyg 4843 days ago
Mechanize is far and away the best and easiest way to scrape with Ruby until anything is rendered in javascript, which is explicitly not supported.

I tend to use Mechanized until I can't, then switch to Watir. Over time, I've found myself just strait up picking up Watir as it runs your browser directly and supports javascript rendering as a result.

1 comments

How is performance with Watir? With casperjs a page takes me on an avg. 5-10 secs. to process.
Not great. About the same...