Hacker News new | ask | show | jobs
by cs702 1152 days ago
This is a brilliant analogy.[a]

It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving something resembling working+long-term memory: They need someone else to write code that

* stores in advance all possible pieces of text that might be be relevant to future prompts;

* finds and retrieves at runtime the pieces of text that are supposedly most relevant to a prompt; and

* tacks on those supposedly most relevant pieces of text as a contextual preamble to each new prompt (query).

Current LLMs truly are Leonard-Like Models.

Surely there must be a better way... but it hasn't been discovered yet.

--

[a] I saw "Memento" years ago and still remember it vividly. It was written and directed by a young Christopher Nolan.

1 comments

Exactly! What could be the next step is removing the (user-facing) prompt at all, since (presumably) there should be enough data for this part to be proactive.