|
|
|
|
|
by sfaist
480 days ago
|
|
Sure!
We use structured output for the endpoint, but not for the jsonata since it's hard to actually describe as a format.
3 big levers for accuracy / reducing hallucinations:
1. direct validation: we apply the jsonata that is generated and check if it really produces what we want (we have the schema after all). This way we can catch errors as they come up.
2. using a reasoning model: by switching to o3-mini, we were able to drastically improve the correctness of the jsonata. takes a bit longer, but better waiting a bit than incorrect mappings.
3. using a confidence score: still in development, but sometimes there are multiple options to map something (e.g. 3 types of prices in the source, but you only want one. Which one?). So we're working on showing the user how "certain" we are that a mapping is correct. |
|