Hacker News new | ask | show | jobs
by er4hn 298 days ago
How many files do you have? At what scale did you see this being a problem?

I'm a fan of Obsidian, not affiliated with them, but my experience with basic file syncing like syncthing or git is that you should be able to easily get up into the ten's of thousands of files without an issue.
2 comments
diggan 298 days ago
The Obsidian Sync (official) plugin isn't very clever with its syncing, it does one file at a time, seemingly new requests for each file.

I recently had to sync a new Obsidian vault from scratch, a vault with thousands of files, and it took minutes to complete because of this, even though most files are a couple of KB at most.

Easy to fix and low hanging fruit, but still an issue for us with many files in our vaults.

link
TechPlasma 298 days ago
I don't want to manage that many files. I'll fully admit that I'll hit my limits before the computer cares.
link
deafpolygon 297 days ago
Same here, but the problem is bigger than that. Having to manage a ton of tiny files makes it easier to lose tiny bits of data. What happens if a file changes, gets overwritten and you don't notice? It's much easier to 'version' a single larger file than many hundreds (thousands?) of tiny files containing 4-5 lines at most.
link