Hacker News new | ask | show | jobs
by jsemrau 800 days ago
Use a local model. For most tasks they are good enough. Let's say Mistral 0.2 instruct is quite solid by now.
2 comments

Do different versions react to prompts in the same way? I imagined the prompt would be tailored to the quirks of a particular version rather than naturally being stably optimal across versions.
I suppose that is one of the benefits of using a local model, that it reduces model risk. I.e., given a certain prompt, it should always reply in the same way. Using a hosted model, operationally you don't have that control over model risk.
What are the best local/open models for accurate tool-calling?