Hacker News new | ask | show | jobs
by okeuro49 197 days ago
Do you run the models locally?

No local model for me manages to get function calling right.

1 comments

Are you using LangGraph tool nodes? I run very small, non-RLHF instruction models with maybe a 2% failure rate on response format matching tool definition. I would also guess you do not have your orchestration and pipe configured correctly.