Hacker News new | ask | show | jobs
by jerpint 1191 days ago
ChatGPT 4 currently accepts 8000 tokens and will eventually support 32k
1 comments

I can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
The help page says you have to select the 8k model to do 8k. If there's no UI for that, then I guess it's API-only. And the 32k one is being rolled out separately. I think you have to sign up for access to that one.