Hacker News new | ask | show | jobs
by tiagozip 391 days ago
scrapers usually don't render a webpage, else their scraping wouldn't be efficient at all.
2 comments

Is that still true? There are so many SPAs out there now that if I were to create a web spider today, I would plan to just render a lot of the pages in a browser rather than fight the status quo. Efficiency wouldn't be my top concern.
That’s bullshit