Hacker News new | ask | show | jobs
by NortySpock 822 days ago
In a similar vein, I have found Benthos to be an incredible swiss-army-knife for transforming data and shoving it either into (or out of) a message bus, webhook, or a database.

https://www.benthos.dev/

2 comments

I wish it was not based on YAML. Pipelines are code, not configuration!!
How does this defer from filebeat?
I don't know which filebeat you are referring to...

https://github.com/elastic/beats/tree/master/filebeat

This one? I only looked for a moment, but filebeat appears to be ingestion only. Benthos does input, output, side-effects, stream-stream joins, metrics-on-the-side, tiny-json-wrangling-webooks, and more. I find it to be like plumbers putty, closing over tooling gaps and smoothing rough edges where ordinarily you'd have to write 20 lines of stream processing code and 300 lines of error handling, reporting, and performance hacks.