|
|
|
|
|
|
by AStrangeMorrow
683 days ago
|
|
|
At least depends on the approach and use: stuff like outlines (https://github.com/outlines-dev/outlines) that actually changes the sampling to adhere to a grammar and can be used with local/custom models shouldn't be too impacted. Those are not really used on top of openAI models |
|
|