[boulos]

There's still latency, you know ;).

[dx034]

I guess the latency between AWS Frankfurt and GC Belgium should be low enough (5-10ms) to use it for most applications. E.g. storing large amount of data at one provider and renting compute engines for processing at the other one. The latency shouldn't be an issue there, as long as the throughput is high enough.

[poooogles]

Can confirm on this, storage for a lot of stuff is in S3 and compute is GCP preemtpibles. Works if you have a small dataset which requires a large volume of compute.

[dx034]

Is that cheaper than using Google for storage as well? Or are there other reasons for that setup?

[poooogles]

Bit of both, no point moving it as the automation/clients that dump data to S3 make it quite hard to change.

[boulos]

GCS supports the S3 API modulo resumable uploads (we do them differently): https://cloud.google.com/storage/docs/migrating

Feel free to send me a note, my contact info is in my profile (I helped build preemptible VMs and I'm sort of fascinated you're doing this).