[osaariki]

I'm not familiar with how TypeChat works, but Guidance [1] is another similar project that can actually integrate into the token sampling to enforce formats.

[1]: https://github.com/microsoft/guidance

[J_Shelby_J]

It’s logit bias. You don’t even need another library to do this. You can do it with three lines of python.

Here’s an example of one of my implementations of logit bias.

https://github.com/ShelbyJenkins/shelby-as-a-service/blob/74...

[behnamoh]

except that guidance is defunct and is not maintained anymore.

[huac]

did they announce that anywhere? it does appear like progress has slowed down quite a lot.