Hacker News new | ask | show | jobs
by imtringued 671 days ago
I don't know if this will help you, but have you tried langroid?

Even if you don't want to use agents, it is still useful as a convenient library for calling an Open AI compatible endpoint.

https://langroid.github.io/langroid/quick-start/llm-interact...

1 comments

Thanks for mentioning Langroid[1], I am the lead architect/dev. We are starting to see companies use it in production after evaluating alternative frameworks, whether agent-oriented or not.

We started building Langroid in early 2023 after finding existing frameworks lacking in terms of good dev-ex, extensibility and clarity of code. We prioritize code transparency, flexibility, stability, good test coverage. We designed it to be agent-oriented from the start, with an elegant agent orchestration mechanism loosely inspired by various paradigms such as Blackboard Architectures, Actor Model, and Production systems, and process calculi. But as you said, Langroid is useful even if you want to just use a single LLM conversation-state.

[1] https://github.com/langroid/langroid