[gavmor]

Ah, I see. The model returns the name of an appropriate tool, then the client takes arbitrary action, and appends the `tool` message to the chat context, and finally a second call to the model minges these together.

Part of me was hoping for some magic plugin space where I could drop named functions, but I couldn't imagine how.

[jejeyyy77]

You specify the API of your functions (inputs/description).

The LLM will decide which functions to call and with what values.

You perform the actual function execution.

[gavmor]

Thanks.

If their announcement had included the schema of the return value of `response['message']['tool_calls']` it might've been more transparent to me.