|
|
|
|
|
|
by catlifeonmars
262 days ago
|
|
|
This article on OpenAI prompt caching was interesting https://platform.openai.com/docs/guides/prompt-caching As someone who definitely doesn’t know what they’re talking about, I’m going to guess that some analogous optimizations might apply to Claude. Something something… TPU slice cache locality… guestures vaguely |
|
|
https://www.anthropic.com/news/prompt-caching