[Buttons840]

I've found lxml to be more powerful. The lxml library supports xpaths, which I don't believe Beautiful Soup does?

In other words, consider lxml as well.

[yifanl]

lxml is supported (mostly) out of the box for BeautifulSoup, so you can it as a parser behind BS4's nicer interface, which I believe the OP does in the linked codebases.

[traverseda]

I reach for selectolax first if I'm doing relatively tame stuff. Also css selectors are nice.