Y
Hacker News
new
|
ask
|
show
|
jobs
by
zuck_vs_musk
819 days ago
Please elaborate
2 comments
kaiokendev
819 days ago
Matt Rickard has a good entry level blog post about it, from the angle of regex constraining [0]. Context free grammars follow the same principle, except using a finite state machine to restrict the action space.
[0]:
https://matt-rickard.com/rellm
link
dartos
817 days ago
Look at llama.cpp grammars, lmql, or guidance-ai
link
[0]: https://matt-rickard.com/rellm