[dragonwriter]

> I read the description two times and checked examples yet still don’t understand the utility.

It’s a tool for (among other things) building the part of a ChatGPT-like interface that sits between the user and an actual LLM, managing the initial prompt, conversation history, etc.

While the LLM itself is quite important, a lot of the special sauce of an AI agent is going to be on the level that this aims to support, not the LLM itself. (And I suspect a lot of the utility of LLMs will come from doing something at this level other than a typical “chat” interface.)

[abc20230215]

Ah, sounds super-niche.

[dragonwriter]

I think it won’t bein a few years; a whole of the interesting bits of putting LLMs to use is going to be at the level this supports, not building new models.

[abc20230215]

I already feel upset about my future interactions with any online support... But as an average "dark matter" enterprise dev, not sure how useful will it be.