Hacker News new | ask | show | jobs
by jackdeansmith 1123 days ago
By not generating the fixed json structure (brackets, commas, etc...) and skipping the model ahead to the next tokens you actually want to generate, I think