Hacker News new | ask | show | jobs
by erikus 20 days ago
I'm pretty sure the system instructions are a function of your environment and not the same universally. That said, there should be a finite number of branches so still cacheable.
1 comments

System specific stuff is probably quite limited, it can be a short dynamic segment at the end of the system prompt, perhaps.