Hacker News new | ask | show | jobs
by perlgeek 62 days ago
Are there tokens reserved for tool calls? If yes, I can see the equivalence. If not, not so much.
1 comments

Yes, typically the tags used for tool calls get their own special tokens, e.g. https://huggingface.co/google/gemma-4-E4B-it/blob/main/token...