[jordinl]

I'm the author of hnhiring.com, I see you mentioned in another comment. You don't need to scrape Hacker News. You can query Algolia instead:

First search for the "Who is hiring post?": https://hn.algolia.com/api/v1/search_by_date?query=hiring&re...

Note the ID of the first (latest) post and then get the comments: https://hn.algolia.com/api/v1/items/39562986

[nico]

Excellent tip, thank you!

hnhiring.com looks super cool, I'm curious if you have any stats or infographics about the data

have you played with the data and LLMs to try to get some insights?

[jordinl]

There is a trends page at https://hnhiring.com/trends

I only use regexes to extract info. Haven't tried LLMs but that could be useful