[wodenokoto]

I love Unix pipes and I love the immense computational power you can achieve through streaming pipelines. You hear stories of people processing terabytes of data faster and cheaper than a distributed cloud solution, by the virtue of Unix pies[1].

But I don’t really see them in any other environment. I can’t think of anything that uses something similar except for big, distributed data processing pipelines like Apache Beam.

Where’s the Python with streaming pipelines?

[1] https://livefreeordichotomize.com/posts/2019-06-04-using-awk...

[Zhyl]

This is one of the things that I think Perl (still) does really well. It has flags to allow for command-like one liners and has built in things (like the diamond operator) that make it very quick and easy to write 'filter' scripts that read STDIN and print to STDOUT.

Python can do these things, but they aren't very pythonic and they don't feel as natural/intuitive.