The users of LLM-based products don't know that; its programmers do. And what happens when an integration is added or removed; how is the user supposed to know?
So, a programmer with LLM knowledge will have a startup idea to wrap all of this up in a nice little app. You say "turn on the lights", the app passes that to the LLM.
The LLM, having been pre trained on what to do, calls the API to turn on the lights.
The LLM, having been pre trained on what to do, calls the API to turn on the lights.