Hacker News new | ask | show | jobs
by lxe 1676 days ago
> There are many files,

> Most of them don't change very often so there are a lot of duplicate files,

> When they do change, the deltas of the [binaries] are not huge.

We need this but for node_modules

3 comments

The novel trick here is splitting up huge binary files and treat them as if they were many small files.

Node_modulea is already tons and tons of files, and when they are large, they are usually minified and hard to split on any "natural" boundary (like elf sections/symbols etc)

checkout pnpm, it stores each version of package only once, and setup your project's node_modules with symbolic to the exact cached version
for what reason?