Circuits Reading Notes Distill Attention and Augmented Recurrent Neural Networks 1. Neural Turing Machines Extend RNN with an external memory bank.