[wilg]

I was just suggesting something like this to a friend yesterday! (Neither of us know enough to do it or know if it's a good idea.)

However, I do think the context length is one of the top improvements that would make LLMs much more useful.

[pacjam]

If you have a chance try it out via the Discord bot or with the GitHub repo! Or even just check out the short demo GIFs we released (at https://github.com/cpacker/memgpt) to get an idea of the MemGPT inputs/outputs.

The high-level memory read/writes are quite intuitive and you may be surprised at how closely it matches what you were suggesting to your friend.

[littlestymaar]

Same here, it looks like the idea was pretty obvious. Glad to see it implemented though.

Context length being so limited is the number one thing that rules LLM as possessing something that resemble “intelligence”, so if we this kind of unbounded context length we're entering into a completely new universe in terms of LLM abilities.

[shishirpatil]

Thanks @wilg and @littlestymaar ! Yeah totally, with the benefit of hindsight, this makes total sense! Hope you find some of our codebase useful to build on top of. We are an Apache 2.0 licensed open source project and welcome contributions :)