[nbrad]

In general, just providing a schema and asking for the response in JSON with few-shot examples is extremely (99%+) reliable in my experience.

I've found GPT-3.5 more than adequate at inferring schemas and filling them for conventional use cases like chat-based forms (as an alternative to Google Forms/TypeForm); my code and prompts available at: https://github.com/nsbradford/talkformai - i've also used this to extract structured data from code for LLM coding agents (e.g. "return the names of every function in this file")

In my opinion, more and more APIs are likely to become unstructured and be reduced to LLM agents chatting with each other; I wrote a brief blog about this here: https://nickbradford.substack.com/p/llm-agents-behind-every-...