[scale8]

Hey @ramoz, great question. Materialized views have quite a few limitations. We have explored a few solutions using them.

https://cloud.google.com/bigquery/docs/materialized-views-in...

We might still introduce them in a future release to optimise a few queries.

Two years ago we started with Clickhouse - we also built the aggregation pipelines around this. For data ingest we have a variety of different solutions, but at present stream to BigQuery for simplicity rather than anything else.

We will be bringing Clickhouse back soon (we are speaking to them at the moment!) as we try and find a way that would enable those wishing to self-host to have a simple and scalable setup.

Our goal is to support the self-hosed version as we believe that will help the community thrive.

[ramoz]

Makes sense!! We found the same thing with redash and bigquery. We basically do the same, and don’t really need to address much at our scale.

Self-hosted will be important business enabler for you imo. SaaS isn’t so promising in the advent of data as an asset, and beyond exponential growth of data that requires more protective, diverse, and thoughtful enterprise enablement.

[scale8]

Good to hear we are not the only ones!

We think self-hosted might be the right direction. We are going to be putting a ton of effort and energy into our self-hosted offering over the next 6-12 months. We want to support all the major databases. At present we only have MongoDB (not idea for large projects) and BigQuery, although Clickhouse is not too far off now.