Hacker News new | ask | show | jobs
by ec109685 1024 days ago
Do you run into issues with parsing the prompt result? And if so, have you tried using “function” calling versus parsing the more free text output?
1 comments

We haven’t used functions as our text parsing has been pretty high fidelity so far. It’s because we provide an example of the format that we expect. We didn’t feel like fighting too hard with LLMs to get structured output. You will also notice that our input format is not structured as well. Instead of unidiff format we provide the AI side-by-side diff with line number annotations so the it can comment accurately - this is similar to how humans want to look at diffs.

Our OSS code is far behind our proprietary version. We have a lot more going on over there and we don’t use functions in that version as well.

We’ve found things like double quotes, emoji’s and other edge cases are a struggle when trying to get data back.