Hacker News new | ask | show | jobs
by 3abiton 406 days ago
> extract data from websites with precision using XPath selectors.

I've used XPath for crawling with selenium, and it used to be my favorite way, but turned out quite unreliable if you don't combine it with other selectors as certain website are really badly designed and have no good patterns. So what's the added value over pure selenium?

1 comments

Check whether the site is actually server side rendered, because if it's a browser client that talks JSON to the backend, you could do the same.