[babyshake]

Is ChatGPT plugins using something comparable to this under the hood?

[ericlewis]

Yes and no. Whatever they are doing seems more robust than anything else I have tried. Especially with being able to bring context in the conversation to later invocations of tools. I haven't managed to get langchain to do that well.

[antti909]

With Haystack you can also combine the use of [hosted] LLMs and smaller, local models, and different pipelines under the Agent too.