[hxypqr]

Obviously, the cost of using LLM to solve this problem is relatively high. At most, it can only treat LLM as one of the signals instead of processing all the information. Combining LLM with tree models or graph models and adding NER technology may achieve an approximate solution to 2. Can you really trust the answers provided by LLM to be used in a production environment?

[johannesboyne]

The combination is truly key, how we do it:

- Combining LLMs, gradient boosting, and multiple statistical/heuristic based approaches - For LLMs: rely on (quite) large context length + fine-tuning - The (ML) models are used to extract mathematically provable quality checks