|
|
|
|
|
by ahachete
1911 days ago
|
|
S3 only became strongly consistent recently. It is a major feat to do so. I can imagine doing it without controlling the storage layer, network topology and specially network latency is only harder. Could you please elaborate a bit more on how do you achieve it? |
|
There are other object storage systems that have strong consistency guarantees that came out after S3.
It greatly simplifies things that an object written to S3 it is immutable.
On a high level, all writes to your storage use some UUID. All reads use a consistent metadata storage (pick a modern database). After your write is complete and you are sure it is persisted, do the metadata update and return success. Everyone gets a consistent view of the operation.