Y
Hacker News
new
|
ask
|
show
|
jobs
by
okeuro49
197 days ago
Do you run the models locally?
No local model for me manages to get function calling right.
1 comments
spacecadet
197 days ago
Are you using LangGraph tool nodes? I run very small, non-RLHF instruction models with maybe a 2% failure rate on response format matching tool definition. I would also guess you do not have your orchestration and pipe configured correctly.
link