Y
Hacker News
new
|
ask
|
show
|
jobs
by
polynomial
360 days ago
Just to note that Tiktoken is still the tokenizer behind the GPT-4x series, it just uses a different token model. (Post only says GPT-3, implying they were using something else for subsequent iterations.)