Hacker News new | ask | show | jobs
by LeoPanthera 1186 days ago
You still have to include the entire previous conversation, even with the API.
4 comments

There is no "state" beyond this. It's a functional interface, if you will.
There are alternative UI designs that would make it easier to deal with, though. It could be a tree structured conversation. Or, have a way to clone a previous conversation, delete the last few messages, and continue from there.
OpenAI's playground has exactly this.

You can use the history function to go to any point in time, and then delete a few messages and continue from there.

The results are not deterministic either since random sampling is involved.
evem if you do that you are limited to 4096 tokens so you emd uo havimg ti drop older messages to allow ot to fully generate replies