[taftster]

Right. When a tool like this can actually "compose" a dataflow using cloud native components (lamdbas, messaging, storage) in real time, this has potential to be super powerful.

Think of, for example, Apache NiFi [1] but instead of the components being constrained to a single JVM execution, the components are realized as AWS or Azure services. That "operational view" of your architecture would be super neat, especially when statistics about each component can be visualized in real time.

[1] https://nifi.apache.org

[freeqaz]

That's honestly eerily close to what is in my head with what we're building for Refinery. It's a rough nut to crack but we're trying!

https://refinery.io

[taftster]

Neat. Thanks for the link!

[jcims]

Whoa this is pretty cool!

[bostik]

So, like Yahoo Pipes for the 2020's?