Hacker News new | ask | show | jobs
by say_it_as_it_is 682 days ago
This puts like a dozen popular python libraries out of business
2 comments
AStrangeMorrow 682 days ago
At least depends on the approach and use: stuff like outlines (https://github.com/outlines-dev/outlines) that actually changes the sampling to adhere to a grammar and can be used with local/custom models shouldn't be too impacted. Those are not really used on top of openAI models
link
fastball 682 days ago
Once it actually works, sure.

I just tried to use structured outputs with the latest release (openai-python 1.40) and it doesn't think Structured Outputs is a thing.

EDIT: turns out my JSON schema is too large (800 lines + recursive) and seems to be breaking OpenAI's "convert to CFG" step. Whoops.

link