|
|
|
|
|
by csemple
160 days ago
|
|
Yes, on your first point "layer 1" isn't fundamentally new. It's applying standard systems administration principles, because we're currently trusting prompts to do the work of permissions. With the pattern I'm describing, you'd:
- Filter the tools list before the API call based on user permissions
- Pass only allowed tools to the LLM
- The model physically can't reason about calling tools that aren't in its context, blocking it at the source. We remove it at the infrastructure layer, vs. the prompt layer. On your second point, "layer 2," we're currently asking models to actively inhibit their training to obey the constricted action space. With Tool Reification, we'd be training the models to treat speech acts as tools and leverage that training so the model doesn't have to "obey a no"; it fails to execute a "do." |
|