[_pdp_]

I am not sure who is the intended customer for this service.

The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero.

Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilisation.

Btw landing page does not bring much confidence this is serious. Might want to change it to communicate better and also to be attractive to "developers" I guess.

[franga2000]

Depends on what you're doing. Something like "read this text and extract all the phone numbers" or "write a 3-point summary of this email" will perform about the same on all good models.

[h2o_wine]

It's a tool not an SEO branded, shiny website. It's a utility. & model pricing varies considerably for now. This tool will be useless in another year or two.

[pants2]

The equivalent of "Spot Instance" is basically the OpenAI Batch API

[askvictor]

> Also model pricing don't very that much.

I'm curious when AI pricing will couple with energy markets. Then the location of the datacentre will matter considerably