[Majora320]

Good luck downloading 16 million records...

[kuschku]

Why? 16 million isn’t much, maybe 10 to 20 gigabyte if compressed.

I’ve seen IRC bouncers that have more messages stored for a single user (270 million, in fact).

[minimaxir]

You could do that with the Algolia API: https://github.com/minimaxir/get-all-hacker-news-submissions...

But as noted, BigQuery is more pragmatic.

[abhishekjha]

I have a script running on aws right now.