Hacker News new | ask | show | jobs
by sva_ 638 days ago
Somewhat confusingly, it appears the tokenizer vocabulary as well as the context length are both 128k tokens!
1 comments
littlestymaar 637 days ago
Yup, that's why I wanted to clarify things.
link