Hacker News new | ask | show | jobs
by yorwba 750 days ago
That's why they have buttons to choose which model's tokenizer to use.
1 comments

Yes, thank you, I understand that part.

It's the might condition in the description that makes me think the results might not be the exact same as what's used in the live models.

The results are the same.