Hacker News new | ask | show | jobs
by melp 3353 days ago
36T to CrashPlan sits on 36GB of RAM at all times... screw that. rclone never uses more than ~2GB to manage my whole 50TB dataset.

edit: Also, I'm using a SuperMicro chassis, not a Norco. I've got a section where I go into why I went with SuperMicro.

2 comments

Uhm, what exactly is crashplan doing with all that memory?
I wonder if it's related to the memory "issue" with their client, where exceeding 1TB/1 million files, a manual edit of the .ini file to bump the JVM memory allocation is necessary. I remember reading somewhere that it has to do with CRC checksum calculation for all the files? I've had to change the setting multiple times (currently at 8GB for ~8TB/1 million files).

https://support.code42.com/CrashPlan/6/Troubleshooting/Adjus...

Hm, maybe give Borg a shot. For initial backups it's not exactly the fastest thing, though much better after that.
> rclone never uses more than ~2GB to manage my whole 50TB dataset.

How do you handle file versions with rclone?

I guess that's the downside. It only syncs the latest version of every file it syncs.