|
|
|
|
|
by MacsHeadroom
1185 days ago
|
|
Your page suppose that the 32k context window fits 24k words and 48 pages of text. This is incorrect, as OpenAI has already stated about 90 pages of context in 32k tokens. GPT-4 tokens are likely larger and average around 7 characters per token in practice, as is the case with OpenAI Codex (as opposed to GPT-3's four characters per token). This would result in 224,000 characters of context vs 128,000 characters (at 4 char per token) for a total of 84 pages of context. This is closer to OpenAI's own reporting of "about 90 pages of context." |
|