Hacker News new | ask | show | jobs
by faangguyindia 18 days ago
Sonar does seem to have data here: https://opendata.rapid7.com/

But it seems you've to go through their sales team and all for the data.

I can't find CommonCrawl making their DNS resolution available.

1 comments

Common Crawl doesn't publish raw DNS separately, you have to pull the information out of the aggregate database. The WARC-IP-Address header should record the IP Common Crawl connected to for the site.
Good timing, I'm about to release that dataset.