Hacker News new | ask | show | jobs
by twelfthnight 1109 days ago
I've been demoing it and have found it struggles to reliably output structured JSON at the moment. I'm curious if folks have had different experiences and if so what their prompts were.
2 comments

We fine-tuned bison with input set to doc content, and output as JSON, but the generation keeps getting prefixed with some of the input. Waiting to hear back from Google about what we might be doing wrongly. The JSON itself looks great, though.

Edit: sorry, that was a different experiment. The one that worked well was an address splitter, trained off Google Address Validator output, funnily enough. Still, the output JSON got prefixed with some of the address input.

Guidance from Microsoft or Jsonformer might help. Haven’t tried with vertex but it’s a common problem across LLMs that both projects fix.