Hacker News new | ask | show | jobs
by FullyFunctional 3029 days ago
I really want for this to work, but it is so not comparable to Dropbox; Syncthing takes forever to synchronize between machines (all on 1 Gbps LAN) unlike Dropbox, which can saturate my link. It is the best of the Dropbox alternatives I've tried though (having tried almost all) and if it performed better I'd be able to forgive the lack of an iOS client. I'm still evaluating it though (3 hosts, 329GB in 1.3M files).
1 comments

I have about 750,000 files and 38,000 folders (I compile a lot of stuff). Are you putting everything in just one folder or splitting the folders up? I'm on really old hardware with mechanical drives and 100Mbps LAN so my observations are going to be different than yours.

I started out with just one folder syncing everything in '/home/kindone', that takes 30 minutes just to scan every time I started syncthing. Syncing over the LAN would not saturate my network unless it was a large file. That took about five hours to get everything synced when you have 700,000+ 4 - 400KiB c/c++ files. (It seems to send about 4 - 5 files at a time, someone correct me if I'm wrong.)

I removed '/home/kindone' and creating separate folders in syncthing for things like '/home/kindone/build/linux-4.14', /home/kindone/build/wine', and '/home/kindone/Dropbox'. Created about 65 different folder for various things, added them to my other machine on the LAN (that was annoying). Once they started syncing my 100Mbps LAN was saturated. Starting syncthing now takes 5 minutes to scan everything.

With the risk of getting down-voted for being too off-topic, here is my setup and observations:

- the three host range from pretty fast (Coffeelake @ 5 GHz, 32 GiB, Samsung 950 Pro) to just ok fast (some i5 @ 3 GHz, 8 GiB, files from a fast NAS on 10 Gibps)

- I two syncthing folders, with a 90/10 split. Some 155k directories between them. The smaller one is scanned every 6 seconds, the other every hour.

- I have disabled relaying etc. so traffic is only p2p and LAN-only, static IPs.

Observations: Scanning is slow, which is expected. However, even when the scanning is done and Out of Date files are found, nothing happens. Zero bytes are transfered. The syncthing process is running, but at a fairly low rate. Sometimes pausing and resuming seems to start things going, but not always. Even when data is traveling, it's pretty slow, at most 70 MB/s, and usually way under this rate.

Another frustration with Syncthing is that there are entirely too many knobs to frob. I like how setting up Dropbox is stupidly simple and to set up a new host is 1) install Dropbox and 2) add my userid/password, done.

As I have honestly looked for a Dropbox alternative for what must be a decade (primarily because Dropbox, Inc. can read my files) it's truly astonishing to me that nothing else works as well. Of course I have considered writing my own clone, but there are other projects to work on and I don't discount how difficult the problem really is.

EDIT: rewording

EDIT2: FWIW, another "solution" I'm evaluating is to endorse Dropbox but run gocryptfs on top for sensitive files.

Never heard of gocryptfs, tried it for an hour or two and its rather interesting.

I guess you could ask on the forums, https://forum.syncthing.net about your issues and see what they say.