[mvitorino]

How would you efficiently keep continuously updated complex metrics (aggregations, windowed functions, etc) calculated on top of unbounded/streaming data using a database? I'm not saying that Spark is the ideal solution, but there are a set of problems that require tools such as Spark.

[truth_seeker]

One example could be PipelineDB extension for PostgreSQL

http://docs.pipelinedb.com/introduction.html

[bsg75]

https://www.pipelinedb.com/blog/pipelinedb-is-joining-conflu...

[truth_seeker]

I know. But at the same time, 1.0 is pretty much capable. Give it a try and you will realize it.