[MrYellowP]

> information extraction task

I do that with orca-mini-3b in ggml format and it's pretty good at it, at twice the speed. Of all the LLMs I've tried, this one gave me the best results. It just requires a properly written prompt.

[nsomaru]

Could you elaborate on the prompting strategies you have used that are more effective?