Hacker News new | ask | show | jobs
by bebrws 1191 days ago
From what I understand this seems useful if you have a model that will accept a large or unlimited number of tokens. I was looking into doing the same thing with ChatGPT and went with ada to find snippets related to the prompt and then to include those with a prompt to ChatGPT: https://bbarrows.com/posts/using-embeddings-ada-and-chatgpt-...

Does ChatGPT 4 now accept more tokens maybe?
1 comments
jerpint 1191 days ago
ChatGPT 4 currently accepts 8000 tokens and will eventually support 32k
link
inciampati 1191 days ago
I can't get it to eat 8k tokens. I assume this is only available via the api. The web interface is limited to around 2k tokens.
link
sp332 1191 days ago
The help page says you have to select the 8k model to do 8k. If there's no UI for that, then I guess it's API-only. And the 32k one is being rolled out separately. I think you have to sign up for access to that one.
link