Show HN: Agentpanel – Universal LLM API Written in Rust

[hackintoshrao]

Agentpanel is an observability platform for optimizing the control flow, performance, token usage, and correctness of LLM/AI agents!

Built-in @rustlang, the first release of Agent Panel currently features an AI gateway that provides seamless access to 100+ LLMs across 20+ platforms, including OpenAI GPT-4o, Gemini 1.5 Pro latest, AnthropicAI Claude 3.5, MistralAI, Cohere, Groq,Perplexity AI, and more.

[hamasho]

Interesting! And it looks much sane compared to LangChain.

Question: do almost all LLM APIs have the same roles "user", "assistant", and "system"?

[hackintoshrao]

Thank you. Yes, almost all LLM APIs have the same roles. Let me know your thoughts once you try the project.

[mathnmusic]

Gemini models don't have "system" roles.

[akash_sky]

gg stuff