[liampulles]

I'm actively trying to scaffold an LLM for business usecases and my experience totally echoes this. I can tweak the prompt for a very representative set of training data, and then it vomits at a seemingly normal new case.

[arthurcolle]

have you tried to train a model based on your expectation context data and the outputs you want?