Hacker News new | ask | show | jobs
by godspiral 4029 days ago
Its frustrating that they are not publishing the data in such chunks. Its good that they make every year available, but for analysis/reporting, you could reasonably just care about years 2030, 2050, 2100.

1 year of data would mean 120GB files or so (assuming 100 years total)

Breaking it down by lattitude would mean 800MB lattide-year average data sets. Breaking it down by longitude would be very helpful too, and not much reason to not make that breakdown in addition to the lattitude one, which means 5mb data chunks.

Its almost as though they are being intentionally uncooperative by dumping 12TB.

Hopefully, some group makes a web interface that allows downloads in these manageable chunk sizes.