[londons_explore]

I would like to see them offer a decent SLA, but for an increased price.

Ie:

No SLA: $1 per 1000 requests.

With SLA: $2 per 1000 requests. For every minute of downtime, we refund 50% of your daily bill.

Obviously they are free to design their systems to make SLA'd requests have priority when there is a capacity crunch or service issues, and that is really what those customers are paying for.

[Qworg]

I hate to talk my own book, but Microsoft does offer SLAs for Azure OpenAI.

https://learn.microsoft.com/en-us/azure/cognitive-services/o...

Same model availability as well.

[blibble]

by SLA you mean: on outage the status page won't be updated for hours

then they'll refund you 2c for the 8 seconds they say they were down for

[kaliqt]

As is tradition.

[bpodgursky]

This is an absolutely ridiculous ask for a company which is already unable to service the extraordinary demand for their product. AWS itself only credits a month if a service is down for over 30 hours[1]

People are going to use OpenAI if it's good. Nobody really cares about SLA if the product is incredible.

[1] https://aws.amazon.com/legal/service-level-agreements/?aws-s...

[thih9]

If this is a hard requirement, then perhaps parametric insurance[1]?

I don't have any examples at hand but I've heard about an insurance offer tied to SLAs for external products.

[1]: https://en.wikipedia.org/wiki/Parametric_insurance

[rad_gruchalski]

So essentially the price as for without the SLA?

[londons_explore]

No... 10 minutes downtime means they refund 5 days of typical billing...

[moffkalast]

Would this really be worth it for them when they can just charge everyone the $2 and tell them to pound sand when there's an outage? Not like there's a proper competitor yet.

[londons_explore]

It's a form of price differentiation.

Let the people who have money to pay for a very slightly better service give you more money.

[rad_gruchalski]

Ah, now I see it, thanks.