|
|
|
|
|
by cs702
1152 days ago
|
|
This is a brilliant analogy.[a] It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving something resembling working+long-term memory: They need someone else to write code that * stores in advance all possible pieces of text that might be be relevant to future prompts; * finds and retrieves at runtime the pieces of text that are supposedly most relevant to a prompt; and * tacks on those supposedly most relevant pieces of text as a contextual preamble to each new prompt (query). Current LLMs truly are Leonard-Like Models. Surely there must be a better way... but it hasn't been discovered yet. -- [a] I saw "Memento" years ago and still remember it vividly. It was written and directed by a young Christopher Nolan. |
|