|
|
|
|
|
by sigmoid10
255 days ago
|
|
Depends on how strictly you define your types. Are you using pydantic to pass the information to the API? There are a few pitfalls with this, because not everything is fully supported and it gets turned into json behind the scenes. But in principle, the autoregressive engine will simply not allow tokens that break the supplied schema. |
|
Ultimately there are still going to be bugs. For this reason and several others you'll still need it wrapped in a retry.