Hacker News new | ask | show | jobs
by gavino 3707 days ago
It doesn't currently do that, I think it'd be an interesting challenge to try and do that though. It's definitely possible to do.
2 comments
daw___ 3707 days ago
Yep. Have a look at phantomjs [1], or other phantomjs wrappers like casperjs [2].

[1] https://www.npmjs.com/package/phantomjs

[2] https://www.npmjs.com/package/casperjs

link
etatoby 3707 days ago
> interesting challenge

Understatement of the year.

You'd need to either re-implement an entire browser stack or run a headless version of gecko of webkit server-side.

The former entails millions of man-hours of work. The latter opens up your server to all sorts of exploits. Overall a really bad idea.

Besides, single page applications are the worst junk in the entire Web 2.0 cesspool. If you really need to scrape them, they usually come with their own JSON API which you can just piggyback.

link
OJFord 3707 days ago
> entails millions of man-hours of work

Overstatement of the year.

Why on Earth would the OP start from scratch? Besides, though not a solo and OSS effort, Apifier does this; certainly without "millions" of hours having been spent on it.

link