Hacker News new | ask | show | jobs
Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
4 points by terrortang 1017 days ago
I am currently developing an application using OpenAI, and have created distinct API keys to accommodate varying scenarios. However, I've found that managing the usage of these individual API keys isn't as seamless as I would like. Do you know any tools or frameworks specifically for controlling or monitoring the usage of these different API keys?
2 comments
hiimsteveee 1017 days ago
Maybe try https://github.com/langfuse/langfuse

It was recently shared on HN

link
terrortang 1017 days ago
Thanks, will take a look.
link
marcklingen 1016 days ago
Langfuse founder here

Do the API keys map to end users / customers? If yes reporting via Langfuse (UI & GET API) can solve this.

If that's not why you use multiple API keys, you can add an api key id/hash (to not store the key in langfuse) as metadata and then group/filter by this metadata field.

Dm me on Discord[1] if you have more detailed questions.

[1] https://langfuse.com/discord

link
0xebo 1017 days ago
Langfuse is great ! Also check https://www.nebuly.com/
link