Hacker News new | ask | show | jobs
by anxman 403 days ago
Pack ad blockers into your containers. They can be loaded into Chrome and help immensely in suppressing popovers while crawling.
1 comments

Thank you, I'll experiment with that. Tips and advice welcome!
Another cool trick is to deny all the content types you don't care about in your playwright. so if you only want text why bother allowing requests for fonts, css, svgs, images, videos, etc

Just request the html and cap down all the other stuff

PS: I also think this has the nice side-effect of you consuming less resources (that you didnt care about/need anyways) from the server, so win win

That is a great tip, thank you!