Hacker News new | ask | show | jobs
by darknoon 390 days ago
If you were doing a lot of scraping, you could just solve this on a GPU in 1/10 or less of the time it takes a human's phone to do it. Generally you need a decent computer to render a webpage while scraping it these days, so I don't see what this is solving.
1 comments

scrapers usually don't render a webpage, else their scraping wouldn't be efficient at all.
Is that still true? There are so many SPAs out there now that if I were to create a web spider today, I would plan to just render a lot of the pages in a browser rather than fight the status quo. Efficiency wouldn't be my top concern.
That’s bullshit