A relatively "simple" approach (augmented associative memory) gives very good results, check for example the good old "Remembrance Agent", and it may complement a LLM(?)
I didn’t know about the Remembrance Agent, just looked it up, and it sounds super relevant! I’ll definitely dig deeper into it. Thanks a lot for pointing it out and for your comment!