Differentiable Neural Computers

E736824

differentiable memory system memory-augmented neural network neural network architecture

Differentiable Neural Computers are a type of neural network architecture that augments traditional networks with an external, differentiable memory module, enabling them to learn algorithmic and reasoning tasks end-to-end.

Try in SPARQL Jump to: Surface forms Statements Referenced by

Observed surface forms (2)

Surface form	Occurrences
Differentiable Neural Computer	1
Differentiable Neural Computers paper	1

Statements (49)

Predicate	Object
instanceOf	differentiable memory system ⓘ memory-augmented neural network ⓘ neural network architecture ⓘ
alsoKnownAs	DNCs NERFINISHED ⓘ
canLearn	algorithmic tasks ⓘ copying sequences ⓘ graph reasoning tasks ⓘ pathfinding in graphs ⓘ question answering over structured data ⓘ sorting sequences ⓘ
coAuthor	Greg Wayne NERFINISHED ⓘ Malcolm Reynolds NERFINISHED ⓘ
comparedTo	Neural Turing Machines NERFINISHED ⓘ recurrent neural networks ⓘ
controllerType	recurrent neural network ⓘ
designedFor	handling long-term dependencies ⓘ learning algorithms from data ⓘ
developedBy	DeepMind NERFINISHED ⓘ
extends	Neural Turing Machines NERFINISHED ⓘ
field	deep learning ⓘ machine learning ⓘ neural computation ⓘ
firstAuthorOfOriginalPaper	Alex Graves NERFINISHED ⓘ
hasComponent	controller network ⓘ external memory matrix ⓘ read heads ⓘ write heads ⓘ
hasProperty	differentiable memory access ⓘ end-to-end trainable ⓘ supports gradient-based learning ⓘ
improvesOn	Neural Turing Machines memory addressing ⓘ
introducedInPaper	"Hybrid computing using a neural network with dynamic external memory" ⓘ
memoryAddressing	soft attention over memory locations ⓘ
memoryStructure	2D memory matrix ⓘ
optimizationObjective	task-specific loss function ⓘ
publicationYear	2016 ⓘ
publishedIn	Nature NERFINISHED ⓘ
readOperation	weighted sum of memory rows ⓘ
supports	one-shot learning ⓘ relational reasoning ⓘ
trainedWith	backpropagation through time ⓘ stochastic gradient descent ⓘ
typicalControllerImplementation	LSTM ⓘ
usesMechanism	content-based addressing ⓘ differentiable attention ⓘ dynamic memory allocation ⓘ location-based addressing ⓘ temporal link matrix ⓘ
writeOperation	erase and add vectors ⓘ

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Alex Graves → notableWork → Differentiable Neural Computers ⓘ

Alex Graves → knownFor → Differentiable Neural Computers ⓘ

Alex Graves → coAuthorOf → Differentiable Neural Computers ⓘ

this entity surface form: Differentiable Neural Computers paper

Neural Turing Machines (contributions) → inspired → Differentiable Neural Computers ⓘ

subject surface form: Neural Turing Machines

this entity surface form: Differentiable Neural Computer