Hacker News new | ask | show | jobs
by huertouisj 77 days ago
there are scraping subreddits.

if you browse them you will see that bot writers are very annoyed if they can't scrape a site with a headless browser.

you can do what you suggested, but with Linux VMs/containers. windows is too heavy, each VM will cost you 4 GB of RAM

2 comments

The reason to use windows is that anti bot tech is going to be a lot stricter if Linux is detected...
I’m in those. xvfb and headless=false still works great