[busterarm]

I had just this scenario yesterday where Google ran out of capacity of NVMe-based N1 hosts in a zone. I was forced to upgrade a large number of nodes to N2 hosts, which cost more (despite their claims about them being cheaper -- the sustained use discounts are lower) and are still in Beta.

I just wanted info before I started about whether we should expect to be able to even build those hosts that day and they wouldn't give us _anything_. We're not exactly a small company and the amount we're spending with them is large.

Their answer was basically either reserve capacity or screw you. I had to relay that to my CTO.

[martin_bech]

GCP seems like its run like a hobby project. Scary af

[busterarm]

It's because unlike AWS and Azure, they don't actually use it.

[martin_bech]

Thats actually it, and thereby it is a hobby project, that Google could close at any time..

[nautilus12]

That explains everything. Only sell what you yourself would find useful.

[q3k]

Google tried with GAE, which is much closer to the Borg model (“I don't care about VMs, just run this code somewhere for me, and make it scale, make it automatically have access to a database”), but the world wasn't ready for it.

The world wants VMs and virtual networks and firewalls and clickable web interfaces and to run big legacy enterprise apps that MUST NEVER DIE and to fuck around with Terraform and to SSH onto boxes. This sucks, though, and Google SREs know better than to use such terrible abstractions unless forced to. The internal software development ecosystem is eons ahead of anything you can get with any cloud provider, but that sort of alien technology doesn't sell.

Kubernetes/GKE is a good compromise between something that Google sells but Google also wants to use. That, and some of the GCP versions of internal tools (Spanner, BigTable, BigQuery, ...).

[busterarm]

The world wants those things because they have vendor products they need to run and can't just write the software for every tool they'll ever need.

We're all just living in the real world. What to Google looks like non-terrible abstractions looks like Kool Aid elsewhere.

[stainforth]

But what about the Scarface rule: "Never get high on your own supply"?

[nautilus12]

Give me some of that sweet loadbalancer action. Its been like a week, i'm starting to lose it.

[CamperBob2]

Good advice if you're selling sketchy street drugs. Not good advice if you're a software/services provider.

[rexf]

The term is dogfooding

[Thaxll]

AWS does that as well, you think hardware is infinite? You will run out of instances type in any cloud provider, nothing new.

[busterarm]

The problem in that story wasn't them being oversubscribed; it was their communication.