[asabla]

So, do I understand this right. But is this supposed to be a centralized (in a way) application for collecting all OpenTelemtry data related to LLM's? And it's supposed to support various of related services and/or services today?

I see how this can be really useful. But at the same time, how do you guys see your self differentiate your self from cloud hosted equivalents? (e.g dashboard-like services in Azure and similar).

Anyhow, interesting project. I'll keep an eye on it for future use

[patcher99]

Yup, You are on point! We do see the UI/dashnoarding layer to find other usage a bit more as we add more tools(Compare/Evaluate) to help the overall LLM Developer Experience.

Also, I totally get the existing tools like Grafana are great, which is why we built our SDK in a very vendor neutral way using OTEL, So that yiu can send these traces and meyrics to our choice of OTLP backend.

Thanks!