[seungwoolee518]

> What stateful apps are you running?

- Databases. (Usually PostgreSQL, seems like it's pretty easy to setup to replicate between PostgreSQL instances.)

- Qdrant, or milvus. (seems like they're support replication between instances, we've *accidentally* running a replicated DB on Single Ceph Cluster)

- Some user generated contents. (usually from Jupyter Environment)

> Sounds like you want to do your own storage infra?

We don't actually have a "storage infra". it's just a bunch (I really don't think 2 HDD is a part of "Bunch") of disks attached to each machines (or node).

[blinded]

So it sounds like you have state replication at the application at the service level for everything but Jupyter? I'm not familiar with Jupyter but would it be possible to use object storage? Does it support backups? Can you store those backups off site?