Hacker News new | ask | show | jobs
by a_wild_dandan 855 days ago
What problem(s) does this solve? I have a ticket in my backlog. Your SDK unlocks the solution. What is that ticket's title? (I'm a bit thick, and need concrete examples for things to click.)
2 comments

It's LLM specific OpenTelemetry tracing. What's going on inside your model isn't the focus. It's everything surrounding your model. How many prompts are people submitting? How long does each prompt take? Did certain prompts time out or return an error? What's the P95/P99 latency for your LLM? And so on.
Same ticket that gets you to install something like Sentry - you wanna see what's happening in production and get alerted when things go wrong