Y
Hacker News
new
|
ask
|
show
|
jobs
by
noname120
9 days ago
Not true. Try to increase the context window and you will be greeted with an error when you reach the real limit enforced server-side.
2 comments
searealist
9 days ago
The models themselves support up to 1M. You are just charged more for all context over 400k. The 272k limit is just a client limitation to ensure you can never go over 400k since the maximum output size of the model is 128k.
link
noname120
8 days ago
Not true. This is the case for the API, not for subscriptions: they are hard capped at 400k.
link
quotemstr
9 days ago
Perhaps not this for this parameter, but for others? Client side.
link
noname120
17 hours ago
Apart from the local scaffolding you can configure very few parameters, and the ones you can configure are the ones that don’t matter
link