Hacker News new | ask | show | jobs
by newlyretired 3166 days ago
I've done a lot of scraping in my day, and I've found that lxml/requests is 2-3 OOM more resource efficient than a Selenium based browser. That JS/rendering engine is HEAVY!