[numba888]

You can try using online services with best models. With prices like $1 for 10K requests it's hard to make local competitive solution. I'm going to use this approach in my personal projects.

[babyent]

Great! Same I’m using OpenAI models, not local. What about you?