| I haven't built it yet, lack of time, but been thinking about providing a LLM-based help system. We have several modules which have a lot of logic, but which requires the user to know what to do. Often users have been poorly trained when there's been staff changes, and they're not using those modules often. We do have help pages and a manual, but it seems some people struggle to utilize those resources. Using help pages and manuals to solve your very specific problem is a skill, and not one that's taught at most schools, so this is understandable. Thus I've been considering if LLMs could help by providing a more free-form input where the user could describe their needs or issue and the LLM could suggest which operations to do and in which order, which data must be entered where and such. One obstacle is that ChatGPT and friends seem to be very tuned to always provide an answer. In the help case, I'd want it to ask clarifying questions if there are certain variables which must be determined. For example, consider a LLM front to the typical disk partitioning and formatting dialogs. Determining which file system to use is important, as it may matter to the user. So if the user doesn't specify it in their original query I'd like the system to ask rather than just provide steps for a specific one. |