[brootstrap]

You have any experience with numerical weather prediction files? The ftp files you download are typically 'the whole globe' with a bunch of variable stacked like layers of images in a big image file. One of the problems is that a typical numerical weather prediction output has so much fucking data you dont need.

GFS for example. IT has maybe 200 or so timesteps in each forecast, runs 4x a day. There are a shit load of configs to run for the GFS. And each config + output has maybe 300/400 variables in each file? So you download 200 files, each with 400 images in it, each image is pretty dense. Each file is ~200 megs, X 200 files. You do the math. Get that 4x a day. And that is just one forecast model. We have lots more, and many more that have higher resolution and denser data.

The biggest problem i think is they have a goddamn free-ass oldschool FTP server. They are allowing dimwit grad school scrip kiddies to code up whatever shit they want. Infinite loops to try and download gobs of data you dont understand? sure go ahead.

They dont even know how to trakc users. they want to keep an open server, and use IP Address as unique ID. I suggested to use fucking tokens, or username/pass combo at least haha