[tedchs]

Status update says they're running Ceph, an S3 work-alike. I don't want to say "clone" because nobody outside Amazon really knows how S3 works, and Ceph merely has an external HTTP API that supposedly works the same way. Is anybody running Ceph at scale and might be able to comment on what broke down?

[avtar]

I'm interested in Ceph-in-production stories as well. I subscribe to this feed http://www.sebastien-han.fr/blog/ which follows Ceph development and have been toying with the idea of testing it when time permits. Currently we use local storage for VM hosts provided by LVM but something distributed and designed with HA in mind would be helpful.

[McGlockenshire]

> Is anybody running Ceph at scale and might be able to comment on what broke down?

Ceph came from Dreamhost, so it's very likely that they're the best subject matter experts outside of Inktank.

[derefr]

> I don't want to say "clone" because nobody outside Amazon really knows how S3 works

You can deduce quite a bit about S3's system architecture from the kind of time and consistency guarantees it provides, the optimal and pessimal cases for bucket key naming, etc. Riak CS hits pretty much all those same notes, so I would hazard that you can get a good high-level sense of S3's architecture by looking at Riak's.