|
|
|
|
|
by janalsncm
1063 days ago
|
|
Just reading through the GPT4 documentation it doesn’t seem like there’s a ton of difference with what you’ve mentioned. https://platform.openai.com/docs/api-reference/completions/c... Of course we now know that GPT4 is a Mixture of Experts, so under the hood they’re parallelizing computation. They also include a way to modify the logits with presence/frequency penalty terms. |
|