[namibj]

On (6), are you already using WCOJs and/or delta-based joins? If not, check out [0][1].

If you do, you might be interested in the LSM tree ideas [2] from when arrangements where called `ValueHistory` to offload part of the memory usage to SSDs.

[0]: https://github.com/TimelyDataflow/differential-dataflow/tree... [1]: https://mtrlz.dev/api/rust/dogsdogsdogs/index.html (3rd party rustdoc for convenience) [2]: https://github.com/TimelyDataflow/differential-dataflow/issu...