Y
Hacker News
new
|
ask
|
show
|
jobs
by
dolmen
504 days ago
Scrapping modern web pages is hard without full support for JS frameworks and dynamic loading. But a full browser, even headless, has huge ressource consumption. This has a huge cost when scraping at scale.