Hacker News new | ask | show | jobs
by marginalia_nu 1481 days ago
I'm probably producing around 250-500 Gb data/month at this point.
3 comments

What's the cumulative size for the index to date? I'm not rich by any measure, but if it's within reach I'd probably fund the storage costs.
Reach out to Jason Scott -- textfiles.com -- and see if he knows anyone who would be interested.

He might know some folks.

Any idea how compressible that is?

If it's something that compresses really well (eg text data in a database), then live compression filesystems (eg ZFS, likely others) could potentially help make that workable.

The data is either already compressed or dense binary soup, so no luck.