Hacker News new | ask | show | jobs
by megous 20 days ago
If it's always the same prompt, can't they have it pre-cached globally for all?
2 comments
erikus 20 days ago
I'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
link
megous 20 days ago
System specific stuff is probably quite limited, it can be a short dynamic segment at the end of the system prompt, perhaps.
link
a_c 20 days ago
The system behaviour is totally up to anthropic's discretion. Its current behaviour is verifiable. In claude code, spawn a subagent with

1. Agent("Test")

2. look at your token usage

3. Repeat a few times

I didn't check again as I type this message but am somewhat sure subagent doesn't cache system prompt as of maybe last week

link