|
|
|
|
|
|
by crosen99
1152 days ago
|
|
|
LLM based autonomous agents remind me a lot of Leonard from the movie Memento. In the movie, Leonard is trying desperately to find the murderer of his wife, but he has one big problem - he can no longer build new memories. So, he needs to develop a system for storing new knowledge and then retrieving the relevant bits every time he formulates a plan for what to do next. Throughput the movie, Leonard makes a number of missteps because his system for recording and retrieving knowledge from this external memory system is imperfect. The movie is very well done. |
|
|
It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving something resembling working+long-term memory: They need someone else to write code that
* stores in advance all possible pieces of text that might be be relevant to future prompts;
* finds and retrieves at runtime the pieces of text that are supposedly most relevant to a prompt; and
* tacks on those supposedly most relevant pieces of text as a contextual preamble to each new prompt (query).
Current LLMs truly are Leonard-Like Models.
Surely there must be a better way... but it hasn't been discovered yet.
--
[a] I saw "Memento" years ago and still remember it vividly. It was written and directed by a young Christopher Nolan.