|
|
|
|
|
|
by funerr
326 days ago
|
|
|
I needed a Python library to handle complex batch requests to LLMs (Anthropic & OpenAI) and couldn't find a good one - so I built one. Batch requests take up to 24h but cut costs by ~50%. Features include structured outputs, automatic cost tracking, state resume after interruptions, and citation support (Anthropic only for now). It's open-source, feedback/contributions welcome! GitHub: https://github.com/agamm/batchata |
|
|