| If we go a bit old-school on AI and reason in the "connectionist" framing: Let's say neural memories are encoded in some high-dimensional vector space. And so memory recall is an associative process that entails constructing a query vector and issuing it across the neural memory space. And the brain is constantly learning, and that learning entails some changes in the structure of the high-dimensional memory space. And let's say that re-encoding of a neural memory happens upon recall, and only upon recall. Then it could be that all experience is in fact stored, but because of changes due to learning, those memories become inaccessible. The machinery constructing query vectors has updated its structure enough that its encoding of those query vectors is sufficiently dissimilar from the encoding of the stored memory vectors (which use the encoding from the last recall). |
https://en.wikipedia.org/wiki/Catastrophic_interference