Hacker News new | ask | show | jobs
by mterron 1837 days ago
https://github.com/mterron/swuniq

Like uniq but works on unsorted input to be used as a pipe filter with constant memory usage.

Feels like this should exist before I made it but all the options that I could find had unbounded memory requirements. I use it in long running pipelines all the time.