Hacker News new | ask | show | jobs
by zuck_vs_musk 819 days ago
Please elaborate
2 comments

Matt Rickard has a good entry level blog post about it, from the angle of regex constraining [0]. Context free grammars follow the same principle, except using a finite state machine to restrict the action space.

[0]: https://matt-rickard.com/rellm

Look at llama.cpp grammars, lmql, or guidance-ai