|
|
|
|
|
by snthpy
381 days ago
|
|
Thanks. I didn't know about this and it looks great. A couple of questions: - do you store them compressed or plain? - what about private info like bank accounts or health issuance? I guess for privacy one could train oneself to use private browsing mode. Regarding compression, for thousands of files don't all those self-extraction headers add up? Wouldn't there be space savings by having a global compression dictionary and only storing the encoded data? |
|
Can’t speak to your other issues but I would think the right file system will save you here. Hopefully someone with more insight can provide color here, but my understanding is that file systems like ZFS were specifically built for use cases like this where you have a large set of data you want to store in a space efficient manner. Rather than a compression dictionary, I believe tech like ZFS simply looks at bytes on disk and compresses those.