Hacker News new | ask | show | jobs
by ako 17 days ago
For open source llms you can give your grammar to the llm to help it decide what valid next tokens it can generate.