[Max-q]

Very interesting. I tried to make a tree based agent two years ago but back then the LLM couldn’t manage to navigate the tree effectively. But today everything is different: better LLMs, and we have better understanding on how to instruct them.

I’ll try it and maybe I’ll be inspired to make my current home brewed agent more document focused again.

One drawback is much higher token usage because we get a very good saving in the cached data.

A little heads up: in your web page, the header download button force double screen with on mobile (iPhone 17 pro). No big problem but always an annoying when a page scrolls in two directions.

[julesrms]

Well, it's good to have the choice of whether to edit the document and break the cache, or not.

Ta for the heads-up, I'll tweak the website!