[StablePunFusion]

The entire company is based around the idea of providing metrics for one closed-source platform's API? Or is the "OpenAI application observability" just one part of what the company does? Otherwise it seems like taking the "all eggs in one basket" to the extreme.

[justintorre75]

OpenAI is just the start to capture most of the market and iterate on some ideas first :). We are adding multiple providers soon. ~Stay tuned~

[meghan_rain]

What providers apart from OpenAI exist?

[justintorre75]

Here are a few...

https://www.ai21.com/ https://www.anthropic.com/ https://cohere.ai/ https://huggingface.co/bigscience/bloom https://goose.ai/ https://bard.google.com/ https://ai.facebook.com/blog/large-language-model-llama-meta...

[quadcore]

"all eggs in one basket" to the extreme.

You couldn't describe better what a startup must do.

[version_five]

To be fair, there are companies based on providing metrics for AWS, e.g. Vantage, so it's not surprising to see VCs making bets in this area

[VWWHFSfQ]

AWS provides services and APIs to support that specific usage. This service is MITM'ing another company's API. I'm pretty sure AWS wouldn't tolerate that sort of thing.

[version_five]

One could think about it as consulting, but productized, on top of a service. Something like AWS is mind numbingly complicated. Amazon has solutions engineers but there's also a big 3rd party market. And some part of that market doesn't need fully bespoke solutions but can be well served by a SaaS that sits on top (of course entailing risk, but it's all risky).

OpenAI isn't there yet, personally I'm bearish on generative AI and openAIs dominance, but they're the major player, and there's a version of the future where they dominate the landscape with a complex enterprise offering like AWS that leaves room for intermediaries. So it's not a bad idea to include bets on people who are building these intermediary products as part of a vc portfolio.

[aryamaan]

(my understanding might in incorrect but) is it not how cloudflare prevents DDOS attack?

[0xDEF]

AWS is a whole other beast than the few dozen REST and SSE endpoints at OpenAI.

[gregschlom]

"Solve one pain point for OpenAI's users, get some nice traction, get acquired by OpenAI in a couple of months" is probably the plan here. Not a bad one to turn a quick profit.

[jacquesm]

Do you think OpenAI is not logging their users' interactions already?

[CGamesPlay]

They certainly aren't exposing those logs back to the customer. There doesn't seem to be a way to see anything other than "total cost per day" in the dashboard. I like that Helicone allows me to see each request and export them all, so that I can use that to build my fine-tuning dataset.

[jacquesm]

True, but why would they acquire a company for something they already have: the users and the logs. The tech is trivial.

[snacktaster]

It seems pretty brittle to me also. And their solution is to actually _proxy_ OAI's API wholesale which doesn't seem like a very good idea and might not even be permitted.

[throwaway280382]

I guess they are betting that openAI will be such a big platform that many companies will need this capability. Not a bad idea I guess

[gmaster1440]

It's a big basket.