|
|
|
|
|
|
by amavashev
92 days ago
|
|
|
The no proxy approach makes sense for LLMs calls. The gap is non LLM calls. Often times damage is done by non LLM calls -- tool calls like sending email, add records, files, placing order, etc. Budget enforcement at the LLM layer wont work for those. built an open protocol + reference implementation, handles both any tool calls, LLM calls, or any other call: https://runcycles.io, open sourced under Apache 2.0 |
|
|