[mft_]

> working on continual learning to explain memory consolidation <how> works in mammals and why we have REM phases during sleep

That's a nice model: human short-term memory is akin to the context window, and REM sleep consolidating longer-term memories is akin to updating the model itself.

How difficult would it be to perform limited focused re-training based on what's been learnt (e.g. new information, new connections, corrections of errors, etc.) within a context window?