[uomopertica]

Machine Learning phd student here! I am currently working on a branch of ML called Continual Learning that deals with this theme exactly. It turns out Artificial Neural Networks have a hard time recalling things they they see in the past [1].

One of the most effective strategies to counter this issue is storing and periodically replaying old training items (i.e. “memories”) for the network [2]. There are also approaches that set out to mimic what we understand of the brain and adopt cue-based approaches [3], but they don’t seem to have reached meaningful outbreaks just yet...

[1] https://en.wikipedia.org/wiki/Catastrophic_interference [2] https://arxiv.org/abs/1902.10486 [3] https://arxiv.org/abs/1711.10563