[a3n]

Would it go significantly quicker if you downloaded it to a VPS instead of your home?

[baldfat]

That would help but the cost of storage for 11 TB and the up time to download would be extremely expensive. I haven't seen an option that works for less than around $200 to rent and setup.

[a3n]

It seems like if these large public datasets continue to come on line, there will need to be some sort of semi-cooperative distributed data store to make them truly "accessible." Or the data provider will need to provide an access/query API, rather than just a big tank that you can copy if you dare.

[baldfat]

Bit Torrent might actually help as a tool to help distribute these large data sets.

The big issue is that so few people actually would need to download these large dataset.

[a3n]

But possibly many more people could use access to the data while they use the apps that were made possible by the data.

[a3n]

$200 isn't all that much, if it lets you get results while you're still alive. :)

[baldfat]

Tell that to my wife :)