Hacker News new | ask | show | jobs
by IanCal 174 days ago
Do any providers do this level of granularity? Anthropic require explicit cache markers, for example.
1 comments

Anthropic requires explicit cache markers but will “look backwards” some amount, so you don’t need to fall on the exact split to get cached tokens