Hacker News new | ask | show | jobs
by jpyles 408 days ago
I am quite aware, but I actually built most of the scraping logic a long time ago, before I even knew that playwright was a thing.

I am looking to refactor a lot of this, and switching over to playwright is a high priority, using something like camoufox for scraping, instead of just chromium.

Most of my work on this the past month has been simple additions that are nice to haves

1 comments

I was in a similar boat with my scrapers. Started with Selenium 5-6 years ago and only discovered Playwright 2 years ago. Spend a month or so swapping the two, which was well worth it. Cleaner API, async support.
Playwright was miles ahead of selenium but what I think is really overlooked is chromedp
Luckily, I have some experience with playwright, so swapping shouldn't take me too long.

Currently working on a PR to swap over