Hacker News new | ask | show | jobs
by lyjackal 2113 days ago
Data is usually embedded in json or available from an internal api when it's an SPA. Headless browser resources are pretty huge. When doing large scale scraping, headless browser should be a last resort