Y
Hacker News
new
|
ask
|
show
|
jobs
by
IanCal
174 days ago
Do any providers do this level of granularity? Anthropic require explicit cache markers, for example.
1 comments
jgeralnik
174 days ago
Anthropic requires explicit cache markers but will “look backwards” some amount, so you don’t need to fall on the exact split to get cached tokens
link