Hacker News new | ask | show | jobs
by Ryand1234 79 days ago
Hey, 1 question, does it extract interactive data too? I mean data that is visible after interaction, like the collapse bar and others?
1 comments

You can use a browser automation library for rendering JS + interaction (like click collapse button) and then use this library to extract the HTML after interaction. Here is an example of using a AI browser automation library with prompt to interact (but you can also use playwright if you know the exact element to interact)

https://github.com/lightfeed/extractor?tab=readme-ov-file#us...