Using a library like Instructor adds a significant token overhead. While that overhead can be justified, if their use case performs fine without it, I don’t see any reason to add such a dependency.
That's what I was wondering. How the token overhead of function calling with, say, Instructor compares with a regular chat response that includes few-shot learning (schema examples).
Maybe Instructor makes the most sense only when you're working with potentially malicious user data
Maybe Instructor makes the most sense only when you're working with potentially malicious user data