How to webscrape an interactive website with C#?

[pkrzysiek]

Hello, I need to scrape a website (interactive) that has a big list of nested sublists of varying length where at the end, there's a link to copy.

What are the tools in c# to scarpe the website that generates that big lists only when you're descending down it and isn't selenium cause it opens a browser and I need something to do this in the background

[SvenL]

You could try headless playwright. There will be still a browser but it is just a process in the background, no window is shown.

https://playwright.dev/