[miohtama]

Related to compressing data before storing on SSD:

Blosc - faster than memcpy()

https://github.com/Blosc/c-blosc

On right circumstances Blosc is so fast that even speed ups reading data from RAM (read less, decompress in L1 and L2 caches)

[guiriduro]

With RAM sizes not keeping up with Moore's Law, it would make sense to have superfast compression as a pervasive, transparent and Hardware-accelerated feature of a modern OS. SIMD provides hw acceleration to some extent, and is clearly well used by the compression algos, its time that compression becomes 'just part of the furniture' as we're now at the stage where compression is fast enough that it can couple with reduced latency (smaller compressed blocks to load into caches reduces total memory latency) to deliver multiplicative speedups.

[realityking]

I can’t find the original source anymore but in this Macrumors post is a quote talking about memory compression in macOS: https://forums.macrumors.com/threads/this-compressed-memory-...

[t344344]

We do have such stuff. SSDs compress data internally, Linux has transparent memory page compression, Btrfs has transparent compression...

[MikusR]

Old ssds did that. Modern ones usually don't

[electroly]

All major OSes have had transparent memory compression for years now.

[ribasushi]

I can't find anything regarding Linux. Could you share the name of the project/daemon?

[electroly]

I believe "zswap" is the main kernel feature supporting memory compression.

https://lwn.net/Articles/545244/ -- I believe this article was written a bit before zswap was merged into the kernel.

[ribasushi]

zswap is not transparent memory compression: it specifically focus on compressed paged-out faults.

I am not aware of anything that goes the MacOS way: actual compressed ram, with fast in-cpu-cache decompression of the compressed payload carried over the dram bus.

This seems to be the current state of the world: https://unix.stackexchange.com/a/374579