[simondw]

> You would ask an LLM based assistant what it can do

But this has the same problem that it's trying to solve in the first place: the LLM's behavior is unpredictable, and that includes its answers to questions like this. There's no guarantee that it won't hallucinate.

Maybe this can be ameliorated by giving it access to some hard-coded and highly vetted list of capabilities?

[cubefox]

ChatGPT-4 doesn't hallucinate a lot about its own capabilities. A bit of hallucination is acceptable for mundane use cases.