[jappgar]

I've found that for tasks like this you need to ask the model to output its reasoning prior to outputting the "answer".

See "chain of thought" e.g

https://arxiv.org/abs/2201.11903