[zkmon]

Why would the agent send the results of the query "Show me my recent transactions" to LLM? This pretty deterministic results which involve no LLM interpretation or decision making.

I understand that people are no longer writing IF expression in their code, because they think it's too brittle, and so they delegate all "IF" branching logic to LLM, but it beats me why displaying of the results from a database query should involve LLM.

[jimbobimbo]

Why would this even be in the chat? Showing recent transactions is a basic functionality of a bank.

[Traster]

Because the question they're asking isn't "What is the best way to solve this problem" the question they're asking is "Where can I shove my AI into this product".

[JSR_FDED]

Because they want the user to be able to say things like “show me my transactions for business meals in the last month”. That requires an LLM to analyze the transaction descriptions.

[zkmon]

Interpreting the query by LLM is fine. But the problem happened when the query results were routed to LLM, which was unnecessary.

[Muromec]

Taking in the text and calling the database tool is kind of a decision