[roeme]

I would really appreciate if somebody can clear this up for me:

Can one mount Ceph on multiple nodes? (I'm referring to the CephFS part).

I've worked with OCFS2 (which allows you to do exactly this) and liked it very much, but would've loved a clustered backing storage. Which is what Ceph provides.

[Nux]

Theoretically yes, but do note CephFS is not considered "production ready" AFAIK.

GlusterFS is much more focused on the filesystem bit, so why not give that a try, too?