[s1k3s]

It's too much of a generic question to be answered right. Do you need global availability? Do you need high speed downloads? Are you worried about bandwidth costs? etc.

We use S3 + Cloudfront for documents that we want to be quickly accessed by our customers. We use SFTP for our internal docs when we don't care that much about availability and speed.

[ID1452319]

No, not global. Each office only really need access to their own documents, there are over 2,000 offices though. It does need to be high speed and yes cost is a factor.

[didgetmaster]

If you are willing to try out some beta software, give https://didgets.com/ a look. You can load in hundreds of millions of documents or other kinds of files and put meta-data tags on each of them. Queries for individual documents or sets of them execute with sub-second speeds. The software is in beta and available for free download.

Currently working on the indexing feature to index the contents of the files too.

[aborsy]

What SFTP client do you use in Linux?

The command line isn’t very convenient.

[s1k3s]

We don't, we're accessing it programmatically from php, it has built in support. I'm not sure how it works under the hood.