Hacker News new | ask | show | jobs
by 0x457 124 days ago
Sure you get one or two word extra worth of tokens, but you save a lot more compute and time figuring what exactly this offset is.