Hacker News new | ask | show | jobs
by Der_Einzige 214 days ago
Not true and citation needed. Whatever you cite there are competing papers claiming that structured and constrained generation does zero harm to output diversity/creativity (within a schema).
1 comments

That is clearly not possible. Imagine if you asked a model yes/no questions with a schema that didn't contain "yes".

In general you can break any model by using a sampler that chooses bad enough tokens sometimes. I don't think it's well studied how well different models respond to this.