Hacker News new | ask | show | jobs
by OlikEten 1393 days ago
Nice! Finally a web scraping library for the programming language most websites use. It was about time lol
1 comments

Thank you! And exactly as you say, using the same language as the websites gives us some advantages - we have HTTP-only (no client-side JS) crawlers based on the Cheerio library, which mimics jQuery API, and if you later find out that you need to use a full headless browser with Puppeteer, you can just call the utility function injectJquery, and there's very little you have to modify to keep your script working