Hacker News new | ask | show | jobs
by euclaise 1014 days ago
That tweet had it backwards, more tokens in tokenizer means that the 16k token context window typically allows for even longer passages than if LLaMA were 16k