Hacker News new | ask | show | jobs
by erwinkle 2175 days ago
Do you scrape using web requests? Or do you use headless browsing to load the page and extract the contents out of the DOM?
1 comments

I use standard web requests to get raw html and parse the data from it, no headless browsing. I guess all the news pages I've met so far were static.