Y
Hacker News
new
|
ask
|
show
|
jobs
by
jackdeansmith
1123 days ago
By not generating the fixed json structure (brackets, commas, etc...) and skipping the model ahead to the next tokens you actually want to generate, I think