[mahalex]

So, it's a thing that appends "please format your response as the following JSON" to the prompt", then validates the actual response against the schema, all in a "while (true)" loop (literally) until it succeeds. This unbelievable achievement is a work of seven people (authors of the blog post).

Honestly, this is getting beyond embarrassing. How is this the world we live in?

[jlnho]

It's because not everyone can be as gifted as you.

I think the (arguably very prototypical) implementation is not what's interesting here. It's the concept itself. Natural language may soon become the default interface for most of the computing people do on a day to day basis, and tools like these will make it easier to create new applications in this space.

[Edes]

I'm gonna love trying to figure out what query gets the support chatbot to pair me with an actual human so that I can solve something that's off script

[jlnho]

Ideally you would jutst click the "talk to a human" button, but what do I know?

[TeeWEE]

Yeah it’s basically a retry loop. I’m curious about the average response time and the worst case amount of iterations.

At best, all these “retry until successfully” are just hacks to bridge the formal world with the stochastic. It’s just useless without some stats on how it performs.

And even if it conforms. Your not sure the data makes sense. Probably .. but exactly that probably

I would not recommend using this in production.

[lsh123]

Hm... so how do we know that the actual values in the produced json are correct???

[mahalex]

As with anything output by “AI”: you don’t.

[siva7]

One of the authors is Anders Hejlsberg, the guy behind c# and delphi

[rob74]

I think he's probably more of an author in the way that the leader of a research team is always credited on any paper by the team, even if he didn't personally do any actual work on it?

Anyway, TIL that Hejlsberg is also involved with TypeScript...

[mahalex]

That’s what makes it even more embarrassing.