Hacker News new | ask | show | jobs
by tmountain 753 days ago
Do you send that wall of text on every request? Doesn’t that eat a ton of tokens?
1 comments
BiteCode_dev 753 days ago
System prompt.
link
QuadrupleA 753 days ago
System prompt is not free, it's priced like a chat message.
link
pmarreck 752 days ago
OpenAI's ChatGPT "custom instructions" do not add to your token count AFAIK. They ARE limited in size, though.
link
tmountain 753 days ago
Does it get sent every round trip?
link
trolan 753 days ago
If you've built a thread in OpenAI everything is sent each time
link
firesteelrain 753 days ago
I get “memory updated”. It seems like it has some backend DB of sorts.
link
HeatrayEnjoyer 753 days ago
Memory is the personalization feature that learns about you.
link