Hacker News new | ask | show | jobs
by shinzui 1396 days ago
GraphJSON looks nice. Do you mind sharing the clickhouse infrastructure that's powering it?
1 comments

I'm not sure what you mean. ClickHouse is an open source project. You can check it out here https://github.com/ClickHouse/ClickHouse
I believe they are referring to how you architected your ClickHouse deployment(s).

Are you cloud based? Using container orchestration?

Is it one cluster per customer? Multi-tenant? Can I use all standard available ClickHouse integrations?

How do you manage scaling?

Its not the easiest system to manage at scale, so getting some insight here would be a good way to help your customers see some competency here!

Ah I see. Let me answer your questions one by one.

> Are you cloud based? Using container orchestration?

Yes it's all in the cloud. The infrastructure is spun up using terraform and automated using ansible.

> Is it one cluster per customer? Multi-tenant?

Multi tenant with rate limits to ensure one customer doesn't take down the entire cluster.

> Can I use all standard available ClickHouse integrations?

Most of them are enabled by default - for instance window functions are available. If there is one that isn't available, feel free to email me and I'll most likely enable it.

> How do you manage scaling?

Unfortunately ClickHouse doesn't have a notion of consistent hashing, so currently we scale by simply adding more nodes and reindexing the whole table. That being said, Clickhouse is incredibly space efficient, so we haven't had to do this very often.

Thanks. That's exactly what I meant.
Infra meaning hardware ?