[amluto]

None of those support the use case I actually want: an S3-compatible server that stores data locally and replicates to a cloud provider. Ideally it should also store enough integrity-checking metadata what one can verify that everything is replicated correctly to the cloud after the fact.

[aspenmayer]

I don't know if it is a server or client in this context, but have you looked into using rclone? I think due to the nature of the way it intermediates the S3 API, and involves (re)downloading files for some operations, rclone is probably either, or both, depending on what you're doing and how.

https://rclone.org/

https://github.com/rclone/rclone

Specifically, check out this new beta feature called bisync which has use cases that sound a lot like yours:

https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-...

[haiku2077]

I think you want rclone. Specifically a combination of:

a local filesystem remote

a cloud provider remote

rclone serve s3 to serve a local s3 compatible API for the local remote

something orchestating an rclone copy, rclone sync or rclone bisync command to sync the local and cloud remotes. Could be triggered on a timer, or using another tool to watch the local directory for changes and trigger a sync.

[aspenmayer]

I swear I suggested rclone on an old refresh of the page only to find you had posted this nearly an hour ago. I wasn't sure rclone could fit this use case, but I'm glad I wasn't totally off-base in assuming it was very close.

I think you can run rclone as a service, they recommend you use bisync on crontab, for example.

What's bisync? I don't really know, as it's new to me, but it's an experimental beta feature from rclone and sounds neat.

https://rclone.org/bisync/

https://rclone.org/bisync/#sharing-an-encrypted-folder-tree-...

> Sharing an encrypted folder tree between hosts

> bisync can keep a local folder in sync with a cloud service, but what if you have some highly sensitive files to be synched?

> Usage of a cloud service is for exchanging both routine and sensitive personal files between one's home network, one's personal notebook when on the road, and with one's work computer. The routine data is not sensitive. For the sensitive data, configure an rclone crypt remote to point to a subdirectory within the local disk tree that is bisync'd to Dropbox, and then set up an bisync for this local crypt directory to a directory outside of the main sync tree.

[remram]

> https://rclone.org/bisync/

This is quite an amazing man page, at no point does it say what the command does.

It has a lot of details upfront about it being beta, and where its working directory is, and what the limitations are. But what does it do?

[haiku2077]

That's not the manpage, this is the manpage: https://rclone.org/commands/rclone_bisync/

[aspenmayer]

Bidirectional sync via rclone?

[haiku2077]

Yeah for my home server backups I run rclone on a systemd timer

[unsnap_biceps]

Funny enough, MinIO supported that feature via bucket replication. You could set the bucket replication to asynchronous or synchronous, write to MinIO and it would sync away, including custom storage classes on the target bucket. I use it to sync to a aws S3 bucket.

[dardeaup]

Out of curiosity, if using replication how many copies would you expect to be stored locally and how many in the cloud? If using erasure coding, which parameters locally and which in the cloud? How quickly would you expect the replication to cloud to occur?

[amluto]

One or more locally. One in the cloud. I want a local object store that archives, reliably, to the cloud. And I don’t mean some wildly inefficient periodic job that tries to find new objects and archive them — I mean something actually integrated in that reliably and verifiably replicates.