Hacker News new | ask | show | jobs
by kekeblom 3351 days ago
The DNC has a similar structure as the neural turing machine. It has a controller network and a memory matrix with read and write heads. However, the DNC differs in it’s memory accessing mechanisms.

Firstly, the DNC has a memory allocation mechanism ensuring that the network can write to memory that is not being used. Secondly, it also contains free gates that allow the network to explicitly forget data stored in it’s memory. Thirdly, the DNC employs a temporal link matrix which tracks the order in which writes are made. The temporal link matrix allows the location based addressing mechanism to recover from a jump caused by a content based memory access.