Hacker News new | ask | show | jobs
by dm03514 429 days ago
Congratulations, second streaming acquisition in recent memory, after benthos.

Arroyo on paper looks amazing, high performance, advanced streaming primitives like windows and joins.

I think / hope the foundations provide a long term alternative to flink and spark streaming, the extremely heavy jvm-based incumbents.

I only have ~5 hours of experience with it so def an ultra beginner, but it was very UI configuration heavy when I tried it. API based config was mentioned but didn’t slot into the way $dayjob provisions so it was a very hard sell.

In response to this I created a lightweight high performance dev-centric streaming solution powered by duckdb, it’s getting a little traction

https://github.com/turbolytics/sql-flow

Iceberg has been one of the most popular feature so far:

https://sql-flow.com/docs/tutorials/iceberg-sink