[pj_mukh]

“As an example, the question “When did we replace our pool pump?” will be mapped to a category called “pool” before querying the Index database.”

Cool write up! Really appreciate it but incidentally how does this categorization help you get better retrieval results?

[mettamage]

Categorization allows for retrieval strategy

[all2]

In a general sense, you see this crop up in SKILLS.md files and other places, as LLMs have to deal with broad contexts. People try and drill into some taxonomy in a naive fashion using plaintext as a directive, which is not particularly optimal.

I wonder if one could build a 'mixture of experts' at the model level that leveraged a variety of small models "within" a larger model...

[pj_mukh]

because you have a different vector store for each categorization?

What if the question crosses categories?