Hacker News new | ask | show | jobs
by DalasNoin 1480 days ago
I believe they only apply it during training.
1 comments
karmasimida 1480 days ago
right, that is my point. It is hard to know which combination triggers the current tokenization to be interpreted as bird.
link