|
|
|
|
|
by itsderek23
1112 days ago
|
|
Thanks! > Did you hit token limits? While i used TikToken to limit the message history (and keep below the token limit), generally I found that I didn't get better completions by putting a lot of data into the context. Usually the completions got more confusing. I put a limited amount of info into the context and have generally stayed below the token limit. > Are you storing message/ chat histories between sessions Right now, yes. It's pretty important to store everything (each request / response) to debug issues with prompt, context, and the agent call loop. |
|