Hacker News new | ask | show | jobs
by rocgf 951 days ago
Not saying it's not useful, but you can achieve the same result consistently with just a few extra tokens in the prompt.
1 comments
CSMastermind 951 days ago
That's what I do today and I still occasionally see failures that are extremely annoying because there's nothing I can do but resend the request to the API.

It seems like you'd need finetuning to make it truly consistent, which is what I'm assuming they did.

link
rocgf 951 days ago
Yes, so that is the outcome that I would imagine as well - basically it will never fail.

However, I have a virtually 100% success rate with the JSON feature in Langchain.

link